Jul 05 19:29:48 devstack cinder-volume[75132]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 19:29:48 devstack cinder-volume[75132]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 19:29:48 devstack cinder-volume[75132]: we strongly recommend against using it for new projects. Jul 05 19:29:48 devstack cinder-volume[75132]: If you are already using Eventlet, we recommend migrating to a different Jul 05 19:29:48 devstack cinder-volume[75132]: framework. For more detail see Jul 05 19:29:48 devstack cinder-volume[75132]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 19:29:48 devstack cinder-volume[75132]: import eventlet # noqa Jul 05 19:29:51 devstack cinder-volume[75132]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75132) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 19:29:51 devstack cinder-volume[75132]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75132) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 19:29:51 devstack cinder-volume[75132]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75132) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 19:29:51 devstack cinder-volume[75132]: INFO dbcounter [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Registered counter for database cinder Jul 05 19:29:52 devstack cinder-volume[75132]: DEBUG oslo_db.sqlalchemy.engines [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75132) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:29:52 devstack cinder-volume[75132]: DEBUG dbcounter [-] [75132] Writer thread running {{(pid=75132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 19:29:52 devstack cinder-volume[75132]: INFO cinder.rpc [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 19:29:52 devstack cinder-volume[75132]: INFO cinder.rpc [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 19:29:52 devstack cinder-volume[75132]: DEBUG oslo_db.sqlalchemy.engines [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75132) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:29:52 devstack cinder-volume[75132]: INFO cinder.volume.manager [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Determined volume DB was empty at startup. Jul 05 19:29:52 devstack cinder-volume[75132]: DEBUG cinder.volume.manager [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75132) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 19:29:52 devstack cinder-volume[75132]: INFO cinder.volume.manager [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 19:29:52 devstack cinder-volume[75132]: WARNING stevedore.named [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 19:29:52 devstack cinder-volume[75132]: WARNING castellan.key_manager [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 19:29:52 devstack cinder-volume[75132]: WARNING cinder.keymgr.conf_key_mgr [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 19:29:52 devstack cinder-volume[75132]: DEBUG cinder.volume.drivers.lvm [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75132) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 05 19:29:52 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_concurrency.processutils [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.525s {{(pid=75132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_db.sqlalchemy.engines [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75132) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:29:53 devstack cinder-volume[75132]: INFO cinder.rpc [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 05 19:29:53 devstack cinder-volume[75132]: INFO cinder.rpc [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 05 19:29:53 devstack cinder-volume[75132]: WARNING stevedore.named [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 19:29:53 devstack cinder-volume[75132]: WARNING castellan.key_manager [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 19:29:53 devstack cinder-volume[75132]: INFO cinder.volume.manager [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_db.sqlalchemy.engines [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75132) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:29:53 devstack cinder-volume[75132]: INFO oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Starting 1 workers Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Started child 75296 {{(pid=75132) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Full set of CONF: {{(pid=75132) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] ******************************************************************************** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Configuration options gathered from: {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] ================================================================================ {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] allow_availability_zone_fallback = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] allow_compression_on_image_upload = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] allowed_direct_url_schemes = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] api_rate_limit = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] auth_strategy = keystone {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] az_cache_duration = 3600 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_availability_zone = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_host = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_stats_polling_interval = 60 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backup_api_class = cinder.backup.api.API {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backup_name_template = backup-%s {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75296]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backup_use_same_host = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backup_use_temp_snapshot = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] chap_password = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] chap_username = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cinder_internal_tenant_project_id = b499b1793fe146799c8b314121eff666 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cinder_internal_tenant_user_id = 9a365d58dc334d358c02c5a18d0e9341 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cloned_volume_same_az = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cluster = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] compression_format = gzip {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] config_dir = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] config_source = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] control_exchange = openstack {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] debug = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] default_availability_zone = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack sudo[75301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] default_group_type = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] default_volume_type = lvmdriver-1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] disk_geometry = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] driver_client_cert = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack sudo[75301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] driver_client_cert_key = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] driver_data_namespace = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] driver_ssl_cert_path = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] driver_ssl_cert_verify = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] driver_use_ssl = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] enable_force_upload = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] enable_new_services = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] enable_unsupported_driver = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] enforce_multipath_for_image_xfer = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] filter_function = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_api_insecure = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_api_servers = ['http://192.168.122.152/image'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_api_ssl_compression = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_ca_certificates_file = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_certfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_keyfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_num_retries = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance_request_timeout = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] goodness_function = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] graceful_shutdown_timeout = 5 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] group_api_class = cinder.group.api.API {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] host = devstack {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_compress_on_upload = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_conversion_address_space_limit = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_conversion_cpu_limit = 60 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_conversion_disable = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_upload_use_cinder_backend = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_upload_use_internal_tenant = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_volume_cache_enabled = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_volume_cache_max_count = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] init_host_max_objects_retrieval = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] instance_format = [instance: %(uuid)s] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] iscsi_target_flags = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] iscsi_write_cache = on {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] iser_helper = tgtadm {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] iser_ip_address = 192.168.122.152 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] iser_port = 3260 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] log_color = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] log_config_append = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] log_dir = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] log_file = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] log_options = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] log_rotate_interval = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] log_rotate_interval_type = days {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] log_rotation_type = none {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] max_age = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] max_logfile_count = 30 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] max_logfile_size_mb = 200 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] max_over_subscription_ratio = 20.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] message_reap_interval = 86400 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75296]: INFO cinder.volume.manager [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 05 19:29:53 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] message_ttl = 2592000 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] monkey_patch = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] monkey_patch_modules = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] my_ip = 192.168.122.152 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] no_snapshot_gb_quota = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] num_iser_scan_tries = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] num_shell_tries = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] num_volume_device_scan_tries = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] nvmeof_conn_info_version = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] nvmet_ns_id = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] nvmet_port_id = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] osapi_max_limit = 1000 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] osapi_volume_ext_list = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] osapi_volume_listen_port = 8776 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] osapi_volume_use_ssl = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] osapi_volume_workers = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] per_volume_size_limit = -1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] periodic_fuzzy_delay = 60 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] periodic_interval = 60 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] public_endpoint = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] publish_errors = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] quota_backup_gigabytes = 1000 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] quota_backups = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] quota_gigabytes = 1000 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] quota_groups = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] quota_snapshots = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] quota_volumes = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] rate_limit_burst = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] rate_limit_except_level = CRITICAL {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] rate_limit_interval = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] reinit_driver_count = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] replication_device = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] report_discard_supported = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] report_interval = 120 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] reservation_clean_interval = 86400 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] reservation_expire = 86400 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] reserved_image_namespaces = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] reserved_percentage = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] rpc_response_timeout = 120 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] run_external_periodic_tasks = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] scst_target_driver = iscsi {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] scst_target_iqn_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:53 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_down_time = 720 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] shell_completion = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] snapshot_name_template = snapshot-%s {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] snapshot_same_host = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] split_loggers = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] state_path = /opt/stack/data/cinder {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] storage_availability_zone = nova {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] storage_protocol = iSCSI {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] syslog_log_facility = LOG_USER {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] target_helper = lioadm {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] target_ip_address = 192.168.122.152 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] target_port = 3260 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] target_protocol = iscsi {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] target_secondary_ip_addresses = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] trace_flags = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] transport_url = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] until_refresh = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] use_chap_auth = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] use_default_quota_class = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] use_journal = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] use_json = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] use_multipath_for_image_xfer = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] use_stderr = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] use_syslog = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] verify_glance_signatures = enabled {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_api_class = cinder.volume.api.API {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:53 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_backend_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_clear = zero {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_clear_ionice = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_clear_size = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_copy_bps_limit = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_dd_blocksize = 1M {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_name_template = volume-%s {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_service_inithost_offload = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volume_usage_audit_period = month {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] zoning_mode = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:53 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.auth_section = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.auth_type = password {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.auth_version = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.cache = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.certfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.insecure = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.interface = public {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.keyfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_password = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcache_username = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.region_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.service_type = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.152/identity {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.backend = dogpile.cache.null {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.backend_argument = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.backend_expiration_time = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.config_prefix = cache.oslo {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.debug_cache_backend = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.enable_retry_client = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.enable_socket_keepalive = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.enabled = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.expiration_time = 600 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.memcache_dead_retry = 300 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.memcache_sasl_enabled = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.password = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.proxies = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.redis_db = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.redis_server = localhost:6379 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.retry_attempts = 2 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.retry_delay = 0.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.socket_keepalive_count = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.socket_keepalive_idle = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.socket_keepalive_interval = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.socket_timeout = 1.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.tls_allowed_ciphers = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.tls_cafile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.tls_certfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.tls_enabled = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.tls_keyfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cache.username = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] coordination.backend_url = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.asyncio_connection = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.asyncio_slave_connection = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.backend = sqlalchemy {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.connection = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.connection_debug = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.connection_parameters = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.connection_recycle_time = 3600 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.connection_trace = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.db_inc_retry_interval = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.db_max_retries = 20 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.db_max_retry_interval = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.db_retry_interval = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.max_overflow = 50 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.max_pool_size = 5 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.max_retries = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.pool_timeout = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.retry_interval = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.slave_connection = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.sqlite_synchronous = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.synchronous_reader = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] database.use_db_reconnect = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.connection_string = messaging:// {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.enabled = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.es_doc_type = notification {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.es_scroll_size = 10000 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.es_scroll_time = 2m {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.filter_error_trace = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.hmac_keys = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.sentinel_service_name = mymaster {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.socket_timeout = 0.1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.trace_requests = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler.trace_sqlalchemy = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler_jaeger.process_tags = {} {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] profiler_otlp.service_name_prefix = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.enforce_scope = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.policy_default_rule = default {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] privsep_osbrick.group = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] privsep_osbrick.helper_command = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] privsep_osbrick.user = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cinder_sys_admin.group = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cinder_sys_admin.helper_command = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] cinder_sys_admin.user = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.auth_section = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.auth_type = password {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.cafile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.certfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.collect_timing = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.insecure = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.keyfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.send_service_user_token = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.split_loggers = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] service_user.timeout = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.auth_section = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.auth_type = password {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.certfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.collect_timing = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.insecure = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.keyfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.region_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.split_loggers = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] glance.timeout = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.backend_availability_zone = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.chap_password = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.chap_username = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.disk_geometry = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.driver_client_cert = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.driver_data_namespace = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.driver_use_ssl = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.extra_capabilities = {} {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.filter_function = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.goodness_function = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.iscsi_target_flags = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.iser_ip_address = 192.168.122.152 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.iser_port = 3260 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.lvm_share_target = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.lvm_type = auto {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.replication_device = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.report_discard_supported = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.target_helper = tgtadm {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.target_ip_address = 192.168.122.152 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.target_port = 3260 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.target_protocol = iscsi {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.trace_flags = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.use_chap_auth = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volume_backend_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volume_clear = zero {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_reports.file_event_handler = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_reports.log_dir = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.backend_host = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.chap_password = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.chap_username = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.disk_geometry = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.filter_function = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.goodness_function = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.iser_helper = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.iser_port = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.lvm_type = auto {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.replication_device = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.storage_protocol = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.target_ip_address = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.target_port = 3260 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.trace_flags = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volume_clear = zero {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] lvmdriver-1.volumes_dir = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_notifications.driver = [] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] key_manager.fixed_key = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.barbican_api_version = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.barbican_endpoint = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.barbican_endpoint_type = public {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.barbican_region_name = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.cafile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.certfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.collect_timing = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.insecure = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.keyfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.number_of_retries = 60 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.retry_delay = 1 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.send_service_user_token = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.split_loggers = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.timeout = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.verify_ssl = True {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican.verify_ssl_path = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican_service_user.auth_section = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican_service_user.auth_type = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican_service_user.cafile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican_service_user.certfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican_service_user.collect_timing = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican_service_user.insecure = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican_service_user.keyfile = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican_service_user.split_loggers = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] barbican_service_user.timeout = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.approle_role_id = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.approle_secret_id = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.kv_mountpoint = secret {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.kv_path = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.kv_version = 2 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.namespace = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.root_token_id = **** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.ssl_ca_crt_file = None {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.timeout = 60.0 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.use_ssl = False {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:29:53 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] ******************************************************************************** {{(pid=75132) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 19:29:54 devstack sudo[75301]: pam_unix(sudo:session): session closed for user root Jul 05 19:29:54 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.781s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:54 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:54 devstack sudo[75347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:29:54 devstack sudo[75347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:29:54 devstack sudo[75347]: pam_unix(sudo:session): session closed for user root Jul 05 19:29:54 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.660s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:54 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:29:54 devstack cinder-volume[75296]: INFO cinder.brick.local_dev.lvm [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 05 19:29:54 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:54 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:54 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:54 devstack sudo[75609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:29:54 devstack sudo[75609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:29:55 devstack sudo[75609]: pam_unix(sudo:session): session closed for user root Jul 05 19:29:55 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:55 devstack cinder-volume[75296]: DEBUG cinder.brick.local_dev.lvm [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75296) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 05 19:29:55 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:55 devstack sudo[75843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:29:55 devstack sudo[75843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:29:56 devstack sudo[75843]: pam_unix(sudo:session): session closed for user root Jul 05 19:29:56 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.346s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:56 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:56 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:56 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:56 devstack sudo[76044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:29:56 devstack sudo[76044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:29:57 devstack sudo[76044]: pam_unix(sudo:session): session closed for user root Jul 05 19:29:57 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:57 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:57 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:57 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:57 devstack sudo[76083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 05 19:29:57 devstack sudo[76083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:29:58 devstack sudo[76083]: pam_unix(sudo:session): session closed for user root Jul 05 19:29:58 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.714s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:58 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:58 devstack sudo[76089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:29:58 devstack sudo[76089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:29:59 devstack sudo[76089]: pam_unix(sudo:session): session closed for user root Jul 05 19:29:59 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.751s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:59 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:59 devstack sudo[76095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:29:59 devstack sudo[76095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:29:59 devstack sudo[76095]: pam_unix(sudo:session): session closed for user root Jul 05 19:29:59 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.803s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:29:59 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:29:59 devstack sudo[76107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:29:59 devstack sudo[76107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:00 devstack sudo[76107]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:00 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.818s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:00 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:00 devstack sudo[76111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:30:00 devstack sudo[76111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:01 devstack sudo[76111]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:01 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:01 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:01 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:01 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:01 devstack sudo[76122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:30:01 devstack sudo[76122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:02 devstack sudo[76122]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:02 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.697s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:02 devstack cinder-volume[75296]: INFO cinder.volume.drivers.lvm [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 05 19:30:02 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:02 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:02 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:02 devstack sudo[76127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:30:02 devstack sudo[76127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:02 devstack sudo[76127]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:02 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.750s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:02 devstack cinder-volume[75296]: DEBUG cinder.volume.drivers.lvm [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Updating volume stats {{(pid=75296) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 19:30:02 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:02 devstack sudo[76173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:30:02 devstack sudo[76173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:03 devstack cinder-volume[75132]: DEBUG dbcounter [-] [75132] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:30:03 devstack sudo[76173]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:03 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:03 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:03 devstack sudo[76252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:30:03 devstack sudo[76252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:04 devstack sudo[76252]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:04 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:04 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:04 devstack sudo[76393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:30:04 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:04 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:04 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:04 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:04 devstack sudo[76398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:30:04 devstack sudo[76398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:05 devstack sudo[76398]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:05 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:05 devstack cinder-volume[75296]: INFO cinder.volume.driver [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 19:30:05 devstack cinder-volume[75296]: DEBUG cinder.volume.driver [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75296) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 19:30:05 devstack cinder-volume[75296]: DEBUG oslo_db.sqlalchemy.engines [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:30:05 devstack cinder-volume[75296]: DEBUG dbcounter [-] [75296] Writer thread running {{(pid=75296) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 19:30:05 devstack cinder-volume[75296]: DEBUG cinder.db.api [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Building query based on filter {{(pid=75296) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 19:30:05 devstack cinder-volume[75296]: DEBUG cinder.image.image_utils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75296) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 19:30:05 devstack cinder-volume[75296]: INFO cinder.keymgr.migration [None req-60a28c12-1c22-4f96-93b0-3ab379d5dd56 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 19:30:05 devstack cinder-volume[75296]: DEBUG cinder.volume.drivers.lvm [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Updating volume stats {{(pid=75296) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 19:30:05 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:05 devstack sudo[76402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:30:05 devstack sudo[76402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:06 devstack sudo[76402]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:06 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:06 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:06 devstack sudo[76414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:30:06 devstack sudo[76414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:07 devstack sudo[76414]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:07 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:07 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:07 devstack sudo[76418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:30:07 devstack sudo[76418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:07 devstack sudo[76418]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:07 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:07 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:07 devstack sudo[76421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:30:07 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:08 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:08 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:08 devstack cinder-volume[75296]: DEBUG cinder.manager [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Notifying Schedulers of capabilities ... {{(pid=75296) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:30:08 devstack cinder-volume[75296]: INFO cinder.volume.manager [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Driver initialization completed successfully. Jul 05 19:30:08 devstack cinder-volume[75296]: INFO cinder.manager [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Initiating service 2 cleanup Jul 05 19:30:08 devstack cinder-volume[75296]: INFO cinder.manager [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Service 2 cleanup completed. Jul 05 19:30:08 devstack cinder-volume[75296]: DEBUG cinder.service [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Creating RPC server for service cinder-volume {{(pid=75296) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 19:30:08 devstack cinder-volume[75296]: DEBUG cinder.service [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75296) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 19:30:08 devstack cinder-volume[75296]: INFO cinder.volume.manager [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 05 19:30:08 devstack cinder-volume[75296]: DEBUG cinder.volume.drivers.lvm [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Updating volume stats {{(pid=75296) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 19:30:08 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:08 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:30:08 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:09 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:09 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:09 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:09 devstack sudo[76429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:30:09 devstack sudo[76429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:09 devstack sudo[76429]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:09 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.727s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:09 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:09 devstack sudo[76435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:30:09 devstack sudo[76435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:10 devstack sudo[76435]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:30:10 devstack sudo[76442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:30:10 devstack sudo[76442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:30:11 devstack sudo[76442]: pam_unix(sudo:session): session closed for user root Jul 05 19:30:11 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:30:11 devstack cinder-volume[75296]: INFO cinder.volume.manager [None req-5ae68600-5758-4f70-ae2d-9a2132e88ed0 None None] Driver post RPC initialization completed successfully. Jul 05 19:30:21 devstack cinder-volume[75296]: DEBUG dbcounter [-] [75296] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75296) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:30:21 devstack cinder-volume[75296]: DEBUG dbcounter [-] [75296] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75296) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:31:10 devstack cinder-volume[75296]: DEBUG oslo_service.periodic_task [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75296) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:31:10 devstack cinder-volume[75296]: DEBUG cinder.volume.drivers.lvm [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Updating volume stats {{(pid=75296) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 19:31:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:31:10 devstack sudo[78227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:31:10 devstack sudo[78227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:31:10 devstack sudo[78227]: pam_unix(sudo:session): session closed for user root Jul 05 19:31:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:31:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:31:10 devstack sudo[78230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:31:10 devstack sudo[78230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:31:11 devstack sudo[78230]: pam_unix(sudo:session): session closed for user root Jul 05 19:31:11 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:31:11 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:31:11 devstack sudo[78233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:31:11 devstack sudo[78233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:31:12 devstack sudo[78233]: pam_unix(sudo:session): session closed for user root Jul 05 19:31:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:31:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:31:12 devstack sudo[78236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:31:12 devstack sudo[78236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:31:12 devstack sudo[78236]: pam_unix(sudo:session): session closed for user root Jul 05 19:31:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:31:12 devstack cinder-volume[75296]: DEBUG cinder.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Notifying Schedulers of capabilities ... {{(pid=75296) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:31:12 devstack cinder-volume[75296]: DEBUG oslo_service.periodic_task [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running periodic task VolumeManager._thread_info {{(pid=75296) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:31:12 devstack cinder-volume[75296]: DEBUG cinder.volume.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] thread count: 6 {{(pid=75296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:31:12 devstack cinder-volume[75296]: DEBUG cinder.volume.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] thread info: [<_MainThread(MainThread, started 136581805875328)>, , , , , ] {{(pid=75296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:32:10 devstack cinder-volume[75296]: DEBUG oslo_service.periodic_task [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75296) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:32:10 devstack cinder-volume[75296]: DEBUG cinder.volume.drivers.lvm [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Updating volume stats {{(pid=75296) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 19:32:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:32:10 devstack sudo[81582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:32:10 devstack sudo[81582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:32:10 devstack sudo[81582]: pam_unix(sudo:session): session closed for user root Jul 05 19:32:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:32:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:32:10 devstack sudo[81586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:32:10 devstack sudo[81586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:32:11 devstack sudo[81586]: pam_unix(sudo:session): session closed for user root Jul 05 19:32:11 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:32:11 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:32:11 devstack sudo[81591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:32:11 devstack sudo[81591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:32:12 devstack sudo[81591]: pam_unix(sudo:session): session closed for user root Jul 05 19:32:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:32:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:32:12 devstack sudo[81599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:32:12 devstack sudo[81599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:32:12 devstack sudo[81599]: pam_unix(sudo:session): session closed for user root Jul 05 19:32:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:32:12 devstack cinder-volume[75296]: DEBUG cinder.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Notifying Schedulers of capabilities ... {{(pid=75296) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:32:12 devstack cinder-volume[75296]: DEBUG oslo_service.periodic_task [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running periodic task VolumeManager._thread_info {{(pid=75296) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:32:12 devstack cinder-volume[75296]: DEBUG cinder.volume.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] thread count: 6 {{(pid=75296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:32:12 devstack cinder-volume[75296]: DEBUG cinder.volume.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] thread info: [<_MainThread(MainThread, started 136581805875328)>, , , , , ] {{(pid=75296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:32:21 devstack cinder-volume[75296]: DEBUG dbcounter [-] [75296] Writing DB stats cinder:SELECT=1 {{(pid=75296) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:32:21 devstack cinder-volume[75296]: DEBUG dbcounter [-] [75296] Writing DB stats cinder:UPDATE=1 {{(pid=75296) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:33:10 devstack cinder-volume[75296]: DEBUG oslo_service.periodic_task [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75296) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:33:10 devstack cinder-volume[75296]: DEBUG cinder.volume.drivers.lvm [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Updating volume stats {{(pid=75296) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 19:33:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:33:10 devstack sudo[83624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:33:10 devstack sudo[83624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:33:10 devstack sudo[83624]: pam_unix(sudo:session): session closed for user root Jul 05 19:33:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:33:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:33:10 devstack sudo[83630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:33:10 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:33:11 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root Jul 05 19:33:11 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:33:11 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:33:11 devstack sudo[83634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:33:11 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:33:12 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root Jul 05 19:33:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:33:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:33:12 devstack sudo[83648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:33:12 devstack sudo[83648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:33:12 devstack sudo[83648]: pam_unix(sudo:session): session closed for user root Jul 05 19:33:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:33:12 devstack cinder-volume[75296]: DEBUG cinder.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Notifying Schedulers of capabilities ... {{(pid=75296) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:33:12 devstack cinder-volume[75296]: DEBUG oslo_service.periodic_task [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running periodic task VolumeManager._thread_info {{(pid=75296) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:33:12 devstack cinder-volume[75296]: DEBUG cinder.volume.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] thread count: 6 {{(pid=75296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:33:12 devstack cinder-volume[75296]: DEBUG cinder.volume.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] thread info: [<_MainThread(MainThread, started 136581805875328)>, , , , , ] {{(pid=75296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:34:10 devstack cinder-volume[75296]: DEBUG oslo_service.periodic_task [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75296) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:34:10 devstack cinder-volume[75296]: DEBUG cinder.volume.drivers.lvm [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Updating volume stats {{(pid=75296) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 19:34:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:10 devstack sudo[84889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 19:34:10 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:10 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:10 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:10 devstack sudo[84893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:34:10 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:11 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:11 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:11 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:11 devstack sudo[84907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 19:34:11 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:12 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:12 devstack sudo[84933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 19:34:12 devstack sudo[84933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:12 devstack sudo[84933]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:12 devstack cinder-volume[75296]: DEBUG oslo_concurrency.processutils [None req-794106c6-9903-402a-b54d-14477b635a00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:12 devstack cinder-volume[75296]: DEBUG cinder.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Notifying Schedulers of capabilities ... {{(pid=75296) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:34:12 devstack cinder-volume[75296]: DEBUG oslo_service.periodic_task [None req-794106c6-9903-402a-b54d-14477b635a00 None None] Running periodic task VolumeManager._thread_info {{(pid=75296) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:34:12 devstack cinder-volume[75296]: DEBUG cinder.volume.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] thread count: 6 {{(pid=75296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:34:12 devstack cinder-volume[75296]: DEBUG cinder.volume.manager [None req-794106c6-9903-402a-b54d-14477b635a00 None None] thread info: [<_MainThread(MainThread, started 136581805875328)>, , , , , ] {{(pid=75296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:34:21 devstack cinder-volume[75296]: DEBUG dbcounter [-] [75296] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75296) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:34:29 devstack cinder-volume[75132]: INFO oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Caught SIGTERM, stopping children Jul 05 19:34:29 devstack cinder-volume[75132]: DEBUG oslo_concurrency.lockutils [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Acquiring lock "singleton_lock" {{(pid=75132) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 19:34:29 devstack cinder-volume[75132]: DEBUG oslo_concurrency.lockutils [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Acquired lock "singleton_lock" {{(pid=75132) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 19:34:29 devstack cinder-volume[75132]: DEBUG oslo_concurrency.lockutils [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Releasing lock "singleton_lock" {{(pid=75132) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 19:34:29 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Stop services. {{(pid=75132) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 19:34:29 devstack cinder-volume[75132]: DEBUG oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Killing children. {{(pid=75132) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 19:34:29 devstack cinder-volume[75132]: INFO oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Waiting on 1 children to exit Jul 05 19:34:33 devstack cinder-volume[75296]: DEBUG oslo_concurrency.lockutils [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Acquiring lock "singleton_lock" {{(pid=75296) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 19:34:33 devstack cinder-volume[75296]: DEBUG oslo_concurrency.lockutils [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Acquired lock "singleton_lock" {{(pid=75296) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 19:34:33 devstack cinder-volume[75296]: DEBUG oslo_concurrency.lockutils [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Releasing lock "singleton_lock" {{(pid=75296) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 19:34:33 devstack cinder-volume[75296]: WARNING amqp [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 19:34:33 devstack cinder-volume[75296]: WARNING amqp [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 19:34:33 devstack cinder-volume[75132]: INFO oslo_service.backend._eventlet.service [None req-6996c9f5-8340-4ea9-b1ac-15a49ff662c7 None None] Child 75296 exited with status 0 Jul 05 19:34:33 devstack cinder-volume[85398]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 19:34:33 devstack cinder-volume[85398]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 19:34:33 devstack cinder-volume[85398]: we strongly recommend against using it for new projects. Jul 05 19:34:33 devstack cinder-volume[85398]: If you are already using Eventlet, we recommend migrating to a different Jul 05 19:34:33 devstack cinder-volume[85398]: framework. For more detail see Jul 05 19:34:33 devstack cinder-volume[85398]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 19:34:33 devstack cinder-volume[85398]: import eventlet # noqa Jul 05 19:34:35 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 19:34:35 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 19:34:35 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 19:34:36 devstack cinder-volume[85398]: INFO dbcounter [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Registered counter for database cinder Jul 05 19:34:36 devstack cinder-volume[85398]: DEBUG oslo_db.sqlalchemy.engines [None req-707164df-1d03-457a-b093-d11bd56368ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:34:36 devstack cinder-volume[85398]: DEBUG dbcounter [-] [85398] Writer thread running {{(pid=85398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 19:34:36 devstack cinder-volume[85398]: INFO cinder.rpc [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 19:34:36 devstack cinder-volume[85398]: INFO cinder.rpc [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_db.sqlalchemy.engines [None req-707164df-1d03-457a-b093-d11bd56368ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:34:37 devstack cinder-volume[85398]: INFO cinder.volume.manager [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Determined volume DB was empty at startup. Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG cinder.volume.manager [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85398) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 19:34:37 devstack cinder-volume[85398]: INFO cinder.volume.manager [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 19:34:37 devstack cinder-volume[85398]: WARNING stevedore.named [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 19:34:37 devstack cinder-volume[85398]: WARNING castellan.key_manager [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 19:34:37 devstack cinder-volume[85398]: WARNING cinder.keymgr.conf_key_mgr [None req-707164df-1d03-457a-b093-d11bd56368ee None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 19:34:37 devstack cinder-volume[85398]: INFO cinder.volume.manager [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_db.sqlalchemy.engines [None req-707164df-1d03-457a-b093-d11bd56368ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:34:37 devstack cinder-volume[85398]: INFO oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Starting 1 workers Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Started child 85615 {{(pid=85398) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Full set of CONF: {{(pid=85398) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] ******************************************************************************** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Configuration options gathered from: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] ================================================================================ {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] allow_availability_zone_fallback = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85615]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] allow_compression_on_image_upload = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] allowed_direct_url_schemes = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] api_rate_limit = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] auth_strategy = keystone {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_availability_zone = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_host = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_stats_polling_interval = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backup_api_class = cinder.backup.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backup_name_template = backup-%s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backup_use_same_host = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backup_use_temp_snapshot = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] chap_password = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] chap_username = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cinder_internal_tenant_project_id = b499b1793fe146799c8b314121eff666 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cinder_internal_tenant_user_id = 9a365d58dc334d358c02c5a18d0e9341 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cluster = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] compression_format = gzip {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] compute_api_class = cinder.compute.nova.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] config_dir = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] config_source = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] control_exchange = openstack {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] debug = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] default_availability_zone = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] default_group_type = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] default_volume_type = QuobyteHD {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] disk_geometry = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] driver_client_cert = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] driver_client_cert_key = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] driver_data_namespace = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] driver_ssl_cert_path = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] driver_ssl_cert_verify = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] driver_use_ssl = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] enable_new_services = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] enable_unsupported_driver = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] enabled_backends = ['QuobyteHD'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] enforce_multipath_for_image_xfer = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] filter_function = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_api_insecure = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_api_servers = ['http://192.168.122.152/image'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_api_ssl_compression = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_ca_certificates_file = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_catalog_info = image:glance:publicURL {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_keyfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_num_retries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance_request_timeout = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] goodness_function = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] graceful_shutdown_timeout = 5 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] group_api_class = cinder.group.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] host = devstack {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_compress_on_upload = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_conversion_address_space_limit = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85615]: INFO cinder.volume.manager [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 19:34:37 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.remotefs [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85615) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_conversion_cpu_limit = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_conversion_disable = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_upload_use_cinder_backend = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_upload_use_internal_tenant = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_volume_cache_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_volume_cache_max_count = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] image_volume_cache_max_size_gb = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] init_host_max_objects_retrieval = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] instance_format = [instance: %(uuid)s] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] iscsi_target_flags = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] iscsi_write_cache = on {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] iser_helper = tgtadm {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] iser_ip_address = 192.168.122.152 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] iser_port = 3260 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] log_color = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] log_config_append = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] log_dir = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] log_file = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] log_options = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] log_rotate_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] log_rotate_interval_type = days {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] log_rotation_type = none {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] max_age = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] max_logfile_count = 30 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] max_logfile_size_mb = 200 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] max_over_subscription_ratio = 20.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] message_reap_interval = 86400 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] message_ttl = 2592000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] migration_create_volume_timeout_secs = 300 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] monkey_patch = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] monkey_patch_modules = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] my_ip = 192.168.122.152 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] no_snapshot_gb_quota = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] num_iser_scan_tries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] num_shell_tries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] num_volume_device_scan_tries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] nvmeof_conn_info_version = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] nvmet_ns_id = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] nvmet_port_id = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] osapi_max_limit = 1000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] osapi_volume_ext_list = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] osapi_volume_listen = 0.0.0.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] osapi_volume_listen_port = 8776 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] osapi_volume_use_ssl = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] osapi_volume_workers = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] per_volume_size_limit = -1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] periodic_fuzzy_delay = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] periodic_interval = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] project_id_regex = [0-9a-f\-]+ {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] public_endpoint = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] publish_errors = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] quota_backup_gigabytes = 1000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] quota_backups = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] quota_gigabytes = 1000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] quota_groups = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] quota_snapshots = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] quota_volumes = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] rate_limit_burst = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] rate_limit_except_level = CRITICAL {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] rate_limit_interval = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] reinit_driver_count = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] replication_device = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] report_discard_supported = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] report_interval = 120 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] reservation_clean_interval = 86400 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] reservation_expire = 86400 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] reserved_image_namespaces = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] reserved_percentage = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] rpc_response_timeout = 120 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] run_external_periodic_tasks = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] scst_target_driver = iscsi {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] scst_target_iqn_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_down_time = 720 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] shell_completion = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] snapshot_name_template = snapshot-%s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] split_loggers = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] state_path = /opt/stack/data/cinder {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] storage_availability_zone = nova {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] storage_protocol = iSCSI {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] syslog_log_facility = LOG_USER {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] target_helper = lioadm {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] target_ip_address = 192.168.122.152 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] target_port = 3260 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] target_protocol = iscsi {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] target_secondary_ip_addresses = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] trace_flags = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] transfer_api_class = cinder.transfer.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] transport_url = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] until_refresh = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] use_chap_auth = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] use_default_quota_class = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] use_journal = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] use_json = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] use_multipath_for_image_xfer = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] use_stderr = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] use_syslog = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] verify_glance_signatures = enabled {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_api_class = cinder.volume.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_backend_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_clear = zero {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_clear_ionice = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_clear_size = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_copy_bps_limit = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_dd_blocksize = 1M {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_name_template = volume-%s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_service_inithost_offload = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volume_usage_audit_period = month {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] zoning_mode = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_concurrency.disable_process_locking = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.auth_section = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.auth_type = password {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.auth_version = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.cache = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.delay_auth_decision = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.http_connect_timeout = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.include_service_catalog = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.insecure = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.interface = public {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.keyfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_password = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcache_username = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.region_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.service_token_roles_required = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.service_type = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.token_cache_time = 300 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.152/identity {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.backend = dogpile.cache.null {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.backend_argument = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.backend_expiration_time = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.config_prefix = cache.oslo {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.debug_cache_backend = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.enable_retry_client = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.enable_socket_keepalive = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.expiration_time = 600 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.hashclient_retry_attempts = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85615) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 19:34:37 devstack cinder-volume[85615]: WARNING cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 19:34:37 devstack cinder-volume[85615]: WARNING cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.memcache_dead_retry = 300 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.memcache_pool_maxsize = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.memcache_sasl_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.password = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.proxies = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.redis_db = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.redis_sentinel_service_name = mymaster {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.redis_server = localhost:6379 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Running cmd (subprocess): mount.quobyte {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.retry_attempts = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.retry_delay = 0.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.socket_keepalive_count = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.socket_keepalive_idle = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.socket_keepalive_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.socket_timeout = 1.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.tls_allowed_ciphers = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.tls_cafile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.tls_certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.tls_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.tls_keyfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cache.username = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] coordination.backend_url = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.asyncio_connection = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.asyncio_slave_connection = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.backend = sqlalchemy {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.connection = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.connection_debug = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.connection_parameters = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.connection_recycle_time = 3600 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.connection_trace = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.db_inc_retry_interval = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.db_max_retries = 20 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.db_max_retry_interval = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.db_retry_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.max_overflow = 50 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.max_pool_size = 5 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.max_retries = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.mysql_wsrep_sync_wait = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.pool_timeout = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.retry_interval = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.slave_connection = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.sqlite_synchronous = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.synchronous_reader = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] database.use_db_reconnect = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.connection_string = messaging:// {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.es_doc_type = notification {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.es_scroll_size = 10000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.es_scroll_time = 2m {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.filter_error_trace = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.hmac_keys = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.sentinel_service_name = mymaster {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.socket_timeout = 0.1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.trace_requests = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler.trace_sqlalchemy = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler_jaeger.process_tags = {} {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler_jaeger.service_name_prefix = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] profiler_otlp.service_name_prefix = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.enforce_new_defaults = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.enforce_scope = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.policy_default_rule = default {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.policy_file = policy.yaml {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_policy.remote_timeout = 60.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] privsep_osbrick.group = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] privsep_osbrick.helper_command = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] privsep_osbrick.user = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cinder_sys_admin.group = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cinder_sys_admin.helper_command = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] cinder_sys_admin.user = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.auth_section = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.auth_type = password {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.cafile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.collect_timing = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.insecure = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.keyfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.send_service_user_token = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.split_loggers = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] service_user.timeout = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.auth_section = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.auth_type = password {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.collect_timing = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.insecure = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.keyfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.region_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.split_loggers = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] glance.timeout = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.backend_availability_zone = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.chap_password = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.chap_username = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.disk_geometry = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.driver_client_cert = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.driver_client_cert_key = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.driver_data_namespace = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.driver_use_ssl = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.enable_unsupported_driver = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.extra_capabilities = {} {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.filter_function = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.goodness_function = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.iscsi_target_flags = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.iscsi_write_cache = on {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.iser_helper = tgtadm {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.iser_ip_address = 192.168.122.152 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.iser_port = 3260 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack quobyte-client[85618]: Reading configuration file: /etc/quobyte/client.cfg Jul 05 19:34:37 devstack quobyte-client[85618]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_host = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_login = admin {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_mount_options = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_password = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_private_key = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_share_path = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:34:37 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=85615) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_ssh_port = 22 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.num_shell_tries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.nvmet_port_id = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.quobyte_client_cfg = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85615]: INFO cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 ... Jul 05 19:34:37 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e -c /etc/quobyte/client-cinder.cfg {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.quobyte_volume_url = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.replication_device = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.report_discard_supported = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.reserved_percentage = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.scst_target_driver = iscsi {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.scst_target_iqn_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.storage_protocol = iSCSI {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.target_helper = tgtadm {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.target_ip_address = 192.168.122.152 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.target_port = 3260 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.target_protocol = iscsi {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.trace_flags = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.unique_fqdn_network = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.use_chap_auth = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.volume_backend_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.volume_clear = zero {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.volume_clear_ionice = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.volume_clear_size = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_reports.file_event_handler = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_reports.log_dir = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.backend_availability_zone = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.backend_host = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.chap_password = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.chap_username = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.chiscsi_conf = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.disk_geometry = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.driver_client_cert = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.driver_client_cert_key = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.driver_data_namespace = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.driver_use_ssl = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.extra_capabilities = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.filter_function = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.goodness_function = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.iscsi_target_flags = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.iscsi_write_cache = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.iser_helper = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.iser_ip_address = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.iser_port = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.iser_target_prefix = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_host = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_login = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_mount_options = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_password = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_private_key = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_share_path = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_ssh_port = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.num_shell_tries = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nvmet_ns_id = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.nvmet_port_id = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.replication_device = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.report_discard_supported = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.reserved_percentage = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.scst_target_driver = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.storage_protocol = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.target_helper = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.target_ip_address = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.target_port = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.target_prefix = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.target_protocol = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.trace_flags = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.unique_fqdn_network = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.use_chap_auth = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack sudo[85621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e -c /etc/quobyte/client-cinder.cfg Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.volume_clear = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.volume_clear_ionice = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.volume_clear_size = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] QuobyteHD.volumes_dir = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.ssl = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.ssl_version = {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_notifications.driver = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_notifications.retry = -1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] oslo_messaging_notifications.transport_url = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] key_manager.fixed_key = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.barbican_api_version = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.barbican_endpoint = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.barbican_endpoint_type = public {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.barbican_region_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.cafile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.collect_timing = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.insecure = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.keyfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.number_of_retries = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.retry_delay = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.send_service_user_token = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.split_loggers = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.timeout = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.verify_ssl = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican.verify_ssl_path = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican_service_user.auth_section = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican_service_user.auth_type = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican_service_user.cafile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican_service_user.certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican_service_user.collect_timing = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican_service_user.insecure = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican_service_user.keyfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican_service_user.split_loggers = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] barbican_service_user.timeout = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.approle_role_id = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.approle_secret_id = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.kv_mountpoint = secret {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.kv_path = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.kv_version = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.namespace = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.root_token_id = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.ssl_ca_crt_file = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.timeout = 60.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.use_ssl = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:37 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] ******************************************************************************** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 19:34:38 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:38 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.861s {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:38 devstack cinder-volume[85615]: INFO cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 succeeded Jul 05 19:34:38 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=85615) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:34:38 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.898s {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:34:38 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:38 devstack sudo[85702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:34:38 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:39 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.629s {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:39 devstack cinder-volume[85615]: INFO cinder.volume.driver [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG cinder.volume.driver [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85615) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG oslo_db.sqlalchemy.engines [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85615) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG dbcounter [-] [85615] Writer thread running {{(pid=85615) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG cinder.db.api [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Building query based on filter {{(pid=85615) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG cinder.image.image_utils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85615) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 19:34:39 devstack cinder-volume[85615]: INFO cinder.keymgr.migration [None req-1f120599-e82d-4060-9d46-d5ec04dda50b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=85615) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=85615) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:34:39 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:39 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:34:39 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:40 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.681s {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG cinder.manager [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Notifying Schedulers of capabilities ... {{(pid=85615) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:34:40 devstack cinder-volume[85615]: INFO cinder.volume.manager [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Driver initialization completed successfully. Jul 05 19:34:40 devstack cinder-volume[85615]: INFO cinder.manager [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Initiating service 3 cleanup Jul 05 19:34:40 devstack cinder-volume[85615]: INFO cinder.manager [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Service 3 cleanup completed. Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG cinder.service [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Creating RPC server for service cinder-volume {{(pid=85615) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG cinder.service [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85615) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 19:34:40 devstack cinder-volume[85615]: INFO cinder.volume.manager [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=85615) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.quobyte [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=85615) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:40 devstack sudo[85742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:34:40 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:40 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:40 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.688s {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:40 devstack cinder-volume[85615]: INFO cinder.volume.manager [None req-273aa0fa-a2e4-4f61-9b46-6c3fff4ba6b2 None None] Driver post RPC initialization completed successfully. Jul 05 19:34:45 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-c57ff7f7-f4f8-474b-afad-0b4de734d567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:34:45 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-c57ff7f7-f4f8-474b-afad-0b4de734d567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:34:45 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.quobyte [None req-c57ff7f7-f4f8-474b-afad-0b4de734d567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=85615) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:34:45 devstack cinder-volume[85615]: DEBUG cinder.volume.drivers.quobyte [None req-c57ff7f7-f4f8-474b-afad-0b4de734d567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=85615) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:34:45 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-c57ff7f7-f4f8-474b-afad-0b4de734d567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85615) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:34:45 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-c57ff7f7-f4f8-474b-afad-0b4de734d567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:45 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:34:45 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:45 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:45 devstack cinder-volume[85615]: DEBUG oslo_concurrency.processutils [None req-c57ff7f7-f4f8-474b-afad-0b4de734d567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.626s {{(pid=85615) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:45 devstack cinder-volume[85615]: DEBUG cinder.manager [None req-c57ff7f7-f4f8-474b-afad-0b4de734d567 None None] Notifying Schedulers of capabilities ... {{(pid=85615) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:34:46 devstack cinder-volume[85615]: DEBUG oslo_service.periodic_task [None req-543caff9-cd8d-4051-a903-fc831dcc2331 None None] Running periodic task VolumeManager._thread_info {{(pid=85615) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:34:46 devstack cinder-volume[85615]: DEBUG cinder.volume.manager [None req-543caff9-cd8d-4051-a903-fc831dcc2331 None None] thread count: 6 {{(pid=85615) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:34:46 devstack cinder-volume[85615]: DEBUG cinder.volume.manager [None req-543caff9-cd8d-4051-a903-fc831dcc2331 None None] thread info: [<_MainThread(MainThread, started 127627008569472)>, , , , , ] {{(pid=85615) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:34:47 devstack cinder-volume[85398]: DEBUG dbcounter [-] [85398] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:34:47 devstack cinder-volume[85398]: INFO oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Caught SIGTERM, stopping children Jul 05 19:34:47 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Acquiring lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 19:34:47 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Acquired lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 19:34:47 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Releasing lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 19:34:47 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Stop services. {{(pid=85398) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 19:34:47 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Killing children. {{(pid=85398) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 19:34:47 devstack cinder-volume[85398]: INFO oslo_service.backend._eventlet.service [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Waiting on 1 children to exit Jul 05 19:34:50 devstack cinder-volume[85615]: DEBUG dbcounter [-] [85615] Writing DB stats cinder:SELECT=2 {{(pid=85615) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:34:51 devstack cinder-volume[85615]: DEBUG dbcounter [-] [85615] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85615) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:34:52 devstack cinder-volume[85615]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 05 19:34:53 devstack cinder-volume[86144]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 19:34:53 devstack cinder-volume[86144]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 19:34:53 devstack cinder-volume[86144]: we strongly recommend against using it for new projects. Jul 05 19:34:53 devstack cinder-volume[86144]: If you are already using Eventlet, we recommend migrating to a different Jul 05 19:34:53 devstack cinder-volume[86144]: framework. For more detail see Jul 05 19:34:53 devstack cinder-volume[86144]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 19:34:53 devstack cinder-volume[86144]: import eventlet # noqa Jul 05 19:34:53 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Acquiring lock "singleton_lock" {{(pid=85615) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 19:34:53 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Acquired lock "singleton_lock" {{(pid=85615) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 19:34:53 devstack cinder-volume[85615]: DEBUG oslo_concurrency.lockutils [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Releasing lock "singleton_lock" {{(pid=85615) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 19:34:53 devstack cinder-volume[85615]: WARNING amqp [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 19:34:53 devstack cinder-volume[85615]: WARNING amqp [None req-707164df-1d03-457a-b093-d11bd56368ee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 19:34:55 devstack cinder-volume[86144]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86144) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 19:34:55 devstack cinder-volume[86144]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86144) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 19:34:55 devstack cinder-volume[86144]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86144) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 19:34:56 devstack cinder-volume[86144]: INFO dbcounter [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Registered counter for database cinder Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_db.sqlalchemy.engines [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86144) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG dbcounter [-] [86144] Writer thread running {{(pid=86144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 19:34:56 devstack cinder-volume[86144]: INFO cinder.rpc [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 19:34:56 devstack cinder-volume[86144]: INFO cinder.rpc [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_db.sqlalchemy.engines [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86144) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:34:56 devstack cinder-volume[86144]: INFO cinder.volume.manager [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Determined volume DB was empty at startup. Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG cinder.volume.manager [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86144) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 19:34:56 devstack cinder-volume[86144]: WARNING stevedore.named [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 19:34:56 devstack cinder-volume[86144]: WARNING castellan.key_manager [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 19:34:56 devstack cinder-volume[86144]: WARNING cinder.keymgr.conf_key_mgr [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 19:34:56 devstack cinder-volume[86144]: INFO cinder.volume.manager [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_db.sqlalchemy.engines [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86144) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:34:56 devstack cinder-volume[86144]: INFO oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Starting 1 workers Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Started child 86389 {{(pid=86144) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Full set of CONF: {{(pid=86144) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] ******************************************************************************** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 19:34:56 devstack cinder-volume[86389]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] Configuration options gathered from: {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] ================================================================================ {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] allow_availability_zone_fallback = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] allow_compression_on_image_upload = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] allowed_direct_url_schemes = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] api_rate_limit = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] auth_strategy = keystone {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_availability_zone = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_host = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_stats_polling_interval = 60 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backup_api_class = cinder.backup.api.API {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backup_name_template = backup-%s {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backup_use_same_host = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backup_use_temp_snapshot = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] chap_password = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] chap_username = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cinder_internal_tenant_project_id = b499b1793fe146799c8b314121eff666 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cinder_internal_tenant_user_id = 9a365d58dc334d358c02c5a18d0e9341 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cluster = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] compression_format = gzip {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] compute_api_class = cinder.compute.nova.API {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] config_dir = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] config_source = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] control_exchange = openstack {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] debug = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] default_availability_zone = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] default_group_type = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] default_volume_type = QuobyteHD {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] disk_geometry = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] driver_client_cert = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] driver_client_cert_key = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] driver_data_namespace = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] driver_ssl_cert_path = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] driver_ssl_cert_verify = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] driver_use_ssl = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] enable_new_services = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] enable_unsupported_driver = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] enabled_backends = ['QuobyteHD'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] enforce_multipath_for_image_xfer = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] filter_function = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_api_insecure = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_api_servers = ['http://192.168.122.152/image'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_api_ssl_compression = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_ca_certificates_file = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_catalog_info = image:glance:publicURL {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_certfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_keyfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_num_retries = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance_request_timeout = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] goodness_function = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] graceful_shutdown_timeout = 5 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] group_api_class = cinder.group.api.API {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] host = devstack {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_compress_on_upload = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_conversion_address_space_limit = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_conversion_cpu_limit = 60 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_conversion_disable = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_upload_use_cinder_backend = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_upload_use_internal_tenant = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_volume_cache_enabled = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_volume_cache_max_count = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] image_volume_cache_max_size_gb = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] init_host_max_objects_retrieval = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] instance_format = [instance: %(uuid)s] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] iscsi_target_flags = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] iscsi_write_cache = on {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] iser_helper = tgtadm {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] iser_ip_address = 192.168.122.152 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] iser_port = 3260 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] log_color = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] log_config_append = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] log_dir = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] log_file = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] log_options = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] log_rotate_interval = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] log_rotate_interval_type = days {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] log_rotation_type = none {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] max_age = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] max_logfile_count = 30 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] max_logfile_size_mb = 200 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] max_over_subscription_ratio = 20.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] message_reap_interval = 86400 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] message_ttl = 2592000 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] migration_create_volume_timeout_secs = 300 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] monkey_patch = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] monkey_patch_modules = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] my_ip = 192.168.122.152 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] no_snapshot_gb_quota = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] num_iser_scan_tries = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] num_shell_tries = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] num_volume_device_scan_tries = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] nvmeof_conn_info_version = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] nvmet_ns_id = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] nvmet_port_id = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] osapi_max_limit = 1000 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] osapi_volume_ext_list = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] osapi_volume_listen_port = 8776 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] osapi_volume_use_ssl = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] osapi_volume_workers = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86389) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] per_volume_size_limit = -1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] periodic_fuzzy_delay = 60 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] periodic_interval = 60 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] public_endpoint = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] publish_errors = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] quota_backup_gigabytes = 1000 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] quota_backups = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] quota_gigabytes = 1000 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] quota_groups = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] quota_snapshots = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] quota_volumes = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] rate_limit_burst = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] rate_limit_except_level = CRITICAL {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] rate_limit_interval = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] reinit_driver_count = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] replication_device = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] report_discard_supported = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] report_interval = 120 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] reservation_clean_interval = 86400 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] reservation_expire = 86400 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] reserved_image_namespaces = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] reserved_percentage = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] rpc_response_timeout = 120 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] run_external_periodic_tasks = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] scst_target_driver = iscsi {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] scst_target_iqn_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_down_time = 720 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] shell_completion = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] snapshot_name_template = snapshot-%s {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] split_loggers = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] state_path = /opt/stack/data/cinder {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] storage_availability_zone = nova {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] storage_protocol = iSCSI {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] syslog_log_facility = LOG_USER {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] target_helper = lioadm {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] target_ip_address = 192.168.122.152 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] target_port = 3260 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] target_protocol = iscsi {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] target_secondary_ip_addresses = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] trace_flags = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] transport_url = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] until_refresh = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] use_chap_auth = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] use_default_quota_class = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] use_journal = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] use_json = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] use_multipath_for_image_xfer = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] use_stderr = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] use_syslog = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] verify_glance_signatures = enabled {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_api_class = cinder.volume.api.API {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_backend_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_clear = zero {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_clear_ionice = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_clear_size = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_copy_bps_limit = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_dd_blocksize = 1M {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_name_template = volume-%s {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_service_inithost_offload = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volume_usage_audit_period = month {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] zoning_mode = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_concurrency.disable_process_locking = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.auth_section = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.auth_type = password {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.auth_version = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.cache = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.certfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.include_service_catalog = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.insecure = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.interface = public {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.keyfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_password = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcache_username = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.region_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.service_type = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.152/identity {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.backend = dogpile.cache.null {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.backend_argument = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.backend_expiration_time = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.config_prefix = cache.oslo {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.debug_cache_backend = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.enable_retry_client = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.enable_socket_keepalive = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.enabled = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.expiration_time = 600 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.hashclient_retry_attempts = 2 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.memcache_dead_retry = 300 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.memcache_pool_maxsize = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.memcache_sasl_enabled = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.password = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.proxies = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.redis_db = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.redis_server = localhost:6379 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.retry_attempts = 2 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.retry_delay = 0.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.socket_keepalive_count = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.socket_keepalive_idle = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.socket_keepalive_interval = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.socket_timeout = 1.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.tls_allowed_ciphers = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.tls_cafile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.tls_certfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.tls_enabled = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.tls_keyfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cache.username = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] coordination.backend_url = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.asyncio_connection = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.asyncio_slave_connection = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.backend = sqlalchemy {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.connection = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.connection_debug = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.connection_parameters = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.connection_recycle_time = 3600 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.connection_trace = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.db_inc_retry_interval = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.db_max_retries = 20 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.db_max_retry_interval = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.db_retry_interval = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.max_overflow = 50 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.max_pool_size = 5 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.max_retries = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.mysql_wsrep_sync_wait = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.pool_timeout = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.retry_interval = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.slave_connection = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.sqlite_synchronous = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.synchronous_reader = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] database.use_db_reconnect = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.connection_string = messaging:// {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.enabled = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.es_doc_type = notification {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.es_scroll_size = 10000 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.es_scroll_time = 2m {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.filter_error_trace = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.hmac_keys = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.sentinel_service_name = mymaster {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.socket_timeout = 0.1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.trace_requests = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler.trace_sqlalchemy = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler_jaeger.process_tags = {} {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler_jaeger.service_name_prefix = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] profiler_otlp.service_name_prefix = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.enforce_new_defaults = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.enforce_scope = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.policy_default_rule = default {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.policy_file = policy.yaml {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] privsep_osbrick.group = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] privsep_osbrick.helper_command = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] privsep_osbrick.user = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cinder_sys_admin.group = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cinder_sys_admin.helper_command = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86389) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 19:34:56 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.quobyte [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] cinder_sys_admin.user = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.auth_section = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.auth_type = password {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.cafile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.certfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.collect_timing = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.insecure = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.keyfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.send_service_user_token = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.split_loggers = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] service_user.timeout = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.auth_section = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.auth_type = password {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.quobyte [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.certfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.collect_timing = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.insecure = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.keyfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.region_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Running cmd (subprocess): mount.quobyte {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.split_loggers = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] glance.timeout = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.backend_availability_zone = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.chap_password = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.chap_username = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.disk_geometry = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.driver_client_cert = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.driver_client_cert_key = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.driver_data_namespace = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.driver_use_ssl = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.extra_capabilities = {} {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.filter_function = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.goodness_function = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.iscsi_target_flags = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.iscsi_write_cache = on {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.iser_helper = tgtadm {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.iser_ip_address = 192.168.122.152 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.iser_port = 3260 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_host = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_login = admin {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_mount_options = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_password = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_private_key = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_share_path = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.num_shell_tries = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.quobyte_volume_url = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.replication_device = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.report_discard_supported = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.reserved_percentage = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.target_helper = tgtadm {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.target_ip_address = 192.168.122.152 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.target_port = 3260 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.target_protocol = iscsi {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.trace_flags = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.unique_fqdn_network = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.use_chap_auth = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.volume_backend_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.volume_clear = zero {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.volume_clear_ionice = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.volume_clear_size = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_reports.file_event_handler = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_reports.log_dir = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.backend_availability_zone = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.backend_host = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.chap_password = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.chap_username = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.chiscsi_conf = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.disk_geometry = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.driver_client_cert = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.driver_data_namespace = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.driver_use_ssl = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.extra_capabilities = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.filter_function = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.goodness_function = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.iser_helper = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.iser_ip_address = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.iser_port = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.iser_target_prefix = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_host = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_login = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_mount_options = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_password = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_private_key = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_share_path = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_ssh_port = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.num_shell_tries = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.nvmet_port_id = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.replication_device = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.report_discard_supported = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.reserved_percentage = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.scst_target_driver = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.storage_protocol = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.target_helper = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.target_ip_address = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.target_port = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.target_prefix = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.target_protocol = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.trace_flags = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.use_chap_auth = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.volume_clear = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.volume_clear_size = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] QuobyteHD.volumes_dir = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:56 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack quobyte-client[86393]: Reading configuration file: /etc/quobyte/client.cfg Jul 05 19:34:57 devstack quobyte-client[86393]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.ssl = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_notifications.driver = [] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_notifications.retry = -1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] key_manager.fixed_key = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.barbican_api_version = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.barbican_endpoint = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.barbican_endpoint_type = public {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.barbican_region_name = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.cafile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.certfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.collect_timing = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.insecure = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.keyfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.number_of_retries = 60 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.retry_delay = 1 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.send_service_user_token = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.split_loggers = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.timeout = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.verify_ssl = True {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican.verify_ssl_path = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican_service_user.auth_section = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican_service_user.auth_type = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican_service_user.cafile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican_service_user.certfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican_service_user.collect_timing = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican_service_user.insecure = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican_service_user.keyfile = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican_service_user.split_loggers = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] barbican_service_user.timeout = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.approle_role_id = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.approle_secret_id = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.kv_mountpoint = secret {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.kv_path = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.kv_version = 2 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.namespace = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.root_token_id = **** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.ssl_ca_crt_file = None {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.timeout = 60.0 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.use_ssl = False {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 19:34:57 devstack cinder-volume[86144]: DEBUG oslo_service.backend._eventlet.service [None req-7e817e25-7765-4361-8810-4b34d5153d0f None None] ******************************************************************************** {{(pid=86144) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 19:34:57 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:34:57 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:57 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.629s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:57 devstack cinder-volume[86389]: INFO cinder.volume.driver [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Driver hasn't implemented _init_vendor_properties() Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG cinder.volume.driver [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86389) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_db.sqlalchemy.engines [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86389) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writer thread running {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG cinder.db.api [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Building query based on filter {{(pid=86389) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86389) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:34:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:57 devstack cinder-volume[86389]: INFO cinder.keymgr.migration [None req-01ebaa13-4764-4620-9786-1933004ba297 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 19:34:57 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:34:57 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:58 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.612s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:34:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Driver initialization completed successfully. Jul 05 19:34:58 devstack cinder-volume[86389]: INFO cinder.manager [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Initiating service 3 cleanup Jul 05 19:34:58 devstack cinder-volume[86389]: INFO cinder.manager [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Service 3 cleanup completed. Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG cinder.service [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Creating RPC server for service cinder-volume {{(pid=86389) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG cinder.service [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86389) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 19:34:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:34:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:34:58 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:34:58 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:34:59 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Jul 05 19:34:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.611s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:34:59 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-418259bb-a995-4eea-837f-c6275769dc5d None None] Driver post RPC initialization completed successfully. Jul 05 19:35:06 devstack cinder-volume[86144]: DEBUG dbcounter [-] [86144] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:35:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-df39d203-f361-4121-9aa4-c8d451f081f5 tempest-BackendsCapabilitiesAdminTestsJSON-1964509491 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86389) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 19:35:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3726688f-4cc3-4986-82c9-26804b49575e tempest-BackendsCapabilitiesAdminTestsJSON-1964509491 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86389) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 19:35:08 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=3 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:35:09 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:35:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:35:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 6 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:35:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:35:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-42ca94ef-a892-45fc-8426-d5e3c75c5602 tempest-GroupSnapshotsTest-1567934627 None] Group tempest-GroupSnapshotsTest-Group-1220389222: creating Jul 05 19:35:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-42ca94ef-a892-45fc-8426-d5e3c75c5602 tempest-GroupSnapshotsTest-1567934627 None] Group tempest-GroupSnapshotsTest-Group-1220389222: created successfully Jul 05 19:35:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-42ca94ef-a892-45fc-8426-d5e3c75c5602 tempest-GroupSnapshotsTest-1567934627 None] Create group completed successfully. Jul 05 19:35:55 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:35:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Flow 'volume_create_manager' (945354c9-6133-4cc4-a156-1ab13440078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:35:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1554f778-0649-40cd-8296-5bfe61b35e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1554f778-0649-40cd-8296-5bfe61b35e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-443287948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80335ab9-8ff2-4e46-afc8-1c292495e493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40a591fb10d4051b206ef247d36a8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:35:55Z,use_quota=True,user_id='912d76e6a6bb49628e26e4f694e8dea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97900367-8f2e-47d1-89b8-94e4507fa8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97900367-8f2e-47d1-89b8-94e4507fa8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241a319-4f67-4c6b-b8d8-6fafaec7a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241a319-4f67-4c6b-b8d8-6fafaec7a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80335ab9-8ff2-4e46-afc8-1c292495e493', 'volume_name': 'volume-80335ab9-8ff2-4e46-afc8-1c292495e493', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98551a40-d50c-408c-8c03-210254e4f6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98551a40-d50c-408c-8c03-210254e4f6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c1a3bd-972f-4d7f-8f9e-d7d5a207c38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:56 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Volume 80335ab9-8ff2-4e46-afc8-1c292495e493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80335ab9-8ff2-4e46-afc8-1c292495e493', 'volume_size': 1} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-443287948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80335ab9-8ff2-4e46-afc8-1c292495e493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40a591fb10d4051b206ef247d36a8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:35:55Z,use_quota=True,user_id='912d76e6a6bb49628e26e4f694e8dea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Creating volume 80335ab9-8ff2-4e46-afc8-1c292495e493 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:35:56 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:35:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:35:56 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 1073741824 Jul 05 19:35:56 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Flow 'volume_create_manager' (f2bf3aa7-dc47-4b7b-902e-db33eb2b4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3dc7ef-e040-43cd-a70e-8c7173aab683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3dc7ef-e040-43cd-a70e-8c7173aab683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779481605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f350e1c-604f-47d4-b423-3baaa92c7c80,host='devstack@QuobyteHD#QuobyteHD',id=ac684a01-7052-4cdb-af2c-884e87cd709a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34d039952bb455e92348483ca0dd45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:35:57Z,use_quota=True,user_id='011b6a647f524a3598aebe3c0714f64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87327fdb-9db2-4e45-8432-d92d30bda4ff),volume_type_id=87327fdb-9db2-4e45-8432-d92d30bda4ff)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8b4044-6427-4cff-ba3f-595441ed8d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8b4044-6427-4cff-ba3f-595441ed8d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1473237a-3bb4-4c13-ae81-57a3f16a0280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1473237a-3bb4-4c13-ae81-57a3f16a0280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac684a01-7052-4cdb-af2c-884e87cd709a', 'volume_name': 'volume-ac684a01-7052-4cdb-af2c-884e87cd709a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd4b09b-f808-4bb1-aa2f-b5cf5c646797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd4b09b-f808-4bb1-aa2f-b5cf5c646797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52eadb5d-69b7-4500-9ce2-f15755992f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:57 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Volume ac684a01-7052-4cdb-af2c-884e87cd709a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac684a01-7052-4cdb-af2c-884e87cd709a', 'volume_size': 1} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:35:57 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 1073741824" returned: 0 in 1.847s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:35:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:35:57 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 Jul 05 19:35:57 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:35:58 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493" returned: 0 in 0.765s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] <== create_volume: return (2675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.681s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f350e1c-604f-47d4-b423-3baaa92c7c80,created_at=2026-07-05T17:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779481605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f350e1c-604f-47d4-b423-3baaa92c7c80,host='devstack@QuobyteHD#QuobyteHD',id=ac684a01-7052-4cdb-af2c-884e87cd709a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34d039952bb455e92348483ca0dd45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:35:57Z,use_quota=True,user_id='011b6a647f524a3598aebe3c0714f64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87327fdb-9db2-4e45-8432-d92d30bda4ff),volume_type_id=87327fdb-9db2-4e45-8432-d92d30bda4ff)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Creating volume ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:35:58 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c1a3bd-972f-4d7f-8f9e-d7d5a207c38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80335ab9-8ff2-4e46-afc8-1c292495e493', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:58 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a 1073741824 Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15a7f64-e794-4774-a43d-04c22d38ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:35:58 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:35:58 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Volume volume-80335ab9-8ff2-4e46-afc8-1c292495e493 (80335ab9-8ff2-4e46-afc8-1c292495e493): created successfully Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15a7f64-e794-4774-a43d-04c22d38ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:35:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Flow 'volume_create_manager' (945354c9-6133-4cc4-a156-1ab13440078a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:35:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-40f9d328-effd-4a46-9516-bf25205732dd tempest-DeleteServersTestJSON-1514705528 None] Created volume successfully. Jul 05 19:36:00 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a 1073741824" returned: 0 in 1.487s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:00 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a Jul 05 19:36:00 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:01 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a" returned: 0 in 0.938s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] <== create_volume: return (2583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:36:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.588s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52eadb5d-69b7-4500-9ce2-f15755992f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac684a01-7052-4cdb-af2c-884e87cd709a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bec05a-7519-4063-b625-54cd372b2514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:01 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Volume volume-ac684a01-7052-4cdb-af2c-884e87cd709a (ac684a01-7052-4cdb-af2c-884e87cd709a): created successfully Jul 05 19:36:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bec05a-7519-4063-b625-54cd372b2514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Flow 'volume_create_manager' (f2bf3aa7-dc47-4b7b-902e-db33eb2b4866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:36:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e5c5e677-4cb4-4a77-9b17-f76b00e6d720 tempest-GroupSnapshotsTest-1567934627 None] Created volume successfully. Jul 05 19:36:03 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] GroupSnapshot 96a25aba-abac-4325-a7e3-b964140d5c6e: creating. Jul 05 19:36:03 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Group snapshot 96a25aba-abac-4325-a7e3-b964140d5c6e: creating. {{(pid=86389) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 19:36:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Creating offline snapshot 5727630c-a8ed-4aa5-97ab-bc63d9fa0238 of volume ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:36:03 devstack cinder-volume[86389]: INFO oslo.privsep.daemon [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmporwi4ce0/privsep.sock'] Jul 05 19:36:03 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmporwi4ce0/privsep.sock Jul 05 19:36:03 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:03 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 19:36:03 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 19:36:03 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 19:36:03 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 19:36:03 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 19:36:03 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 19:36:03 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 19:36:03 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 19:36:03 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 19:36:04 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 19:36:04 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 19:36:04 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 19:36:04 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 19:36:04 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 19:36:04 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 19:36:04 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 19:36:04 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 19:36:04 devstack cinder-volume[86389]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 19:36:05 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:05 devstack cinder-volume[86389]: INFO oslo.privsep.daemon [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Spawned new privsep daemon via rootwrap Jul 05 19:36:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Accepted privsep connection to /tmp/tmporwi4ce0/privsep.sock {{(pid=86389) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 05 19:36:05 devstack cinder-volume[86389]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 05 19:36:05 devstack cinder-volume[86389]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 05 19:36:05 devstack cinder-volume[86389]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 05 19:36:05 devstack cinder-volume[86389]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87316 Jul 05 19:36:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ba6a79-e72d-48c3-8ef8-5ab4f06f26d5]: (2,) {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[be480dae-0060-41ab-a1f5-9dc636d189a8]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:05 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a Jul 05 19:36:05 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:05 devstack cinder-volume[86389]: WARNING py.warnings [req-1490361b-38f4-42b8-ac67-379d7118ae82 req-741f2cf4-8b38-43f6-8bb7-521277eb7ff8 tempest-DeleteServersTestJSON-1514705528 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 05 19:36:05 devstack cinder-volume[86389]: .first() Jul 05 19:36:05 devstack cinder-volume[86389]: Jul 05 19:36:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1490361b-38f4-42b8-ac67-379d7118ae82 req-741f2cf4-8b38-43f6-8bb7-521277eb7ff8 tempest-DeleteServersTestJSON-1514705528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:05 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a" returned: 0 in 0.849s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:05 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 1G Jul 05 19:36:05 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:06 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 1G" returned: 0 in 0.865s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac684a01-7052-4cdb-af2c-884e87cd709a -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:06 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac684a01-7052-4cdb-af2c-884e87cd709a -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 Jul 05 19:36:06 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:07 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac684a01-7052-4cdb-af2c-884e87cd709a -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238" returned: 0 in 0.727s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:07 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:36:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:07 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 Jul 05 19:36:07 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:08 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238" returned: 0 in 0.653s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:08 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.info Jul 05 19:36:08 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:08 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.info" returned: 0 in 0.694s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:08 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:36:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:08 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.info Jul 05 19:36:08 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:09 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.info" returned: 0 in 0.983s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.705s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1490361b-38f4-42b8-ac67-379d7118ae82 req-741f2cf4-8b38-43f6-8bb7-521277eb7ff8 tempest-DeleteServersTestJSON-1514705528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.094s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:09 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedc2b79-d9dd-4bb4-83b7-8c21638afaf2]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-1490361b-38f4-42b8-ac67-379d7118ae82 req-741f2cf4-8b38-43f6-8bb7-521277eb7ff8 tempest-DeleteServersTestJSON-1514705528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:10 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7567da66-cb14-4a40-9fa4-1384e7deb6d5 tempest-GroupSnapshotsTest-1567934627 None] group_snapshot 96a25aba-abac-4325-a7e3-b964140d5c6e: created successfully Jul 05 19:36:10 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 Jul 05 19:36:10 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:11 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-1490361b-38f4-42b8-ac67-379d7118ae82 req-741f2cf4-8b38-43f6-8bb7-521277eb7ff8 tempest-DeleteServersTestJSON-1514705528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493" returned: 0 in 1.172s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1490361b-38f4-42b8-ac67-379d7118ae82 req-741f2cf4-8b38-43f6-8bb7-521277eb7ff8 tempest-DeleteServersTestJSON-1514705528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.205s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-1490361b-38f4-42b8-ac67-379d7118ae82 req-741f2cf4-8b38-43f6-8bb7-521277eb7ff8 tempest-DeleteServersTestJSON-1514705528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-80335ab9-8ff2-4e46-afc8-1c292495e493', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59a01523-e89c-41f8-b4f9-1f7f75f2806f', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:36:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-1490361b-38f4-42b8-ac67-379d7118ae82 req-741f2cf4-8b38-43f6-8bb7-521277eb7ff8 tempest-DeleteServersTestJSON-1514705528 None] attachment_update completed successfully. Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-5727630c-a8ed-4aa5-97ab-bc63d9fa0238-eff5f5b7-9786-4453-a677-6b6855f41508" by "_create_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-5727630c-a8ed-4aa5-97ab-bc63d9fa0238-eff5f5b7-9786-4453-a677-6b6855f41508" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Creating volume eff5f5b7-9786-4453-a677-6b6855f41508 from snapshot 5727630c-a8ed-4aa5-97ab-bc63d9fa0238 {{(pid=86389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-eff5f5b7-9786-4453-a677-6b6855f41508" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-eff5f5b7-9786-4453-a677-6b6855f41508" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] snapshot: 5727630c-a8ed-4aa5-97ab-bc63d9fa0238, volume: eff5f5b7-9786-4453-a677-6b6855f41508, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d126fc-e35a-430c-82dc-e5d16f6ef08f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:12 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 Jul 05 19:36:12 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:13 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238" returned: 0 in 0.840s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac684a01-7052-4cdb-af2c-884e87cd709a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:36:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:36:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:36:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e87c4d-6257-40aa-b50c-02c018e4b283]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:13 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a Jul 05 19:36:13 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:14 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a" returned: 0 in 0.810s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:14 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:36:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:14 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 Jul 05 19:36:14 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:36:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:36:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:36:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:16 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:36:16 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Flow 'volume_create_manager' (9240683b-637c-4570-8a31-b31b8fa19041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34174019-4b26-4e08-ba3a-0aa0c8b65e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:17 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34174019-4b26-4e08-ba3a-0aa0c8b65e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1208148808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9012be-aff6-4f08-9f06-1e91c8203026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3e2e1f486495fa3783ca4d96ee06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:36:17Z,use_quota=True,user_id='feda2d043b1b4019897e5842026e36e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98cc5fe-f65f-44f0-bb93-772ee7ce9563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98cc5fe-f65f-44f0-bb93-772ee7ce9563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0aff867-271a-4bd1-999b-6425295590ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0aff867-271a-4bd1-999b-6425295590ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9012be-aff6-4f08-9f06-1e91c8203026', 'volume_name': 'volume-2d9012be-aff6-4f08-9f06-1e91c8203026', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78da40c6-6c01-44df-8ba1-d27bdd4e7d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78da40c6-6c01-44df-8ba1-d27bdd4e7d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b9ab57-c9bf-47c5-9fb1-38cbc42223a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:18 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Volume 2d9012be-aff6-4f08-9f06-1e91c8203026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9012be-aff6-4f08-9f06-1e91c8203026', 'volume_size': 1} Jul 05 19:36:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.845s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:18 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:36:18 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:36:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 8 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:36:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:36:21 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508" returned: 0 in 6.974s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:21 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5acbc5-24b2-4e94-b04a-771a9aea04c6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:21 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a Jul 05 19:36:21 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:22 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a" returned: 0 in 1.119s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:22 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:36:22 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Converted 1024.00 MB image at 146.81 MB/s Jul 05 19:36:22 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:36:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:22 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 Jul 05 19:36:22 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:22 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508" returned: 0 in 0.724s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-eff5f5b7-9786-4453-a677-6b6855f41508" released by "_copy_volume_from_snapshot" :: held 10.655s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:36:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-7dd6959e-cd28-4e01-a560-df8daf881560 req-fc1730e8-ba3c-4419-8976-e7ac9964a949 tempest-DeleteServersTestJSON-1514705528 None] Terminate volume connection completed successfully. Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-7dd6959e-cd28-4e01-a560-df8daf881560 req-fc1730e8-ba3c-4419-8976-e7ac9964a949 tempest-DeleteServersTestJSON-1514705528 None] Deleting attachment 59a01523-e89c-41f8-b4f9-1f7f75f2806f. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-5727630c-a8ed-4aa5-97ab-bc63d9fa0238-eff5f5b7-9786-4453-a677-6b6855f41508" released by "_create_volume_from_snapshot" :: held 10.707s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.747s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1208148808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9012be-aff6-4f08-9f06-1e91c8203026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3e2e1f486495fa3783ca4d96ee06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:36:17Z,use_quota=True,user_id='feda2d043b1b4019897e5842026e36e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Creating volume 2d9012be-aff6-4f08-9f06-1e91c8203026 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:36:23 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:36:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:23 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026 1073741824 Jul 05 19:36:23 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9ef5ebd7-2065-4e50-8481-f15e145177c6 tempest-GroupSnapshotsTest-1567934627 None] Create group from source-snapshot-96a25aba-abac-4325-a7e3-b964140d5c6e completed successfully. Jul 05 19:36:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-eff5f5b7-9786-4453-a677-6b6855f41508" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:36:24 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026 1073741824" returned: 0 in 1.179s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-eff5f5b7-9786-4453-a677-6b6855f41508" acquired by "delete_volume" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:36:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:24 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c41fc9-63ee-47f3-828a-e48401e94490]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:24 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026 Jul 05 19:36:24 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:24 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 Jul 05 19:36:24 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:25 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026" returned: 0 in 0.791s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:36:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b9ab57-c9bf-47c5-9fb1-38cbc42223a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9012be-aff6-4f08-9f06-1e91c8203026', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e669b0-2717-4b62-81bd-6c8c747c97d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:25 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Volume volume-2d9012be-aff6-4f08-9f06-1e91c8203026 (2d9012be-aff6-4f08-9f06-1e91c8203026): created successfully Jul 05 19:36:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e669b0-2717-4b62-81bd-6c8c747c97d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Flow 'volume_create_manager' (9240683b-637c-4570-8a31-b31b8fa19041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:36:25 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-65200e26-2e1e-48e2-9333-4f957d97a754 tempest-AttachVolumeShelveTestJSON-1102601362 None] Created volume successfully. Jul 05 19:36:25 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508" returned: 0 in 0.887s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:25 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508 Jul 05 19:36:25 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:26 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eff5f5b7-9786-4453-a677-6b6855f41508" returned: 0 in 0.853s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-eff5f5b7-9786-4453-a677-6b6855f41508" released by "delete_volume" :: held 1.839s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['0f8aa363-349a-44cb-8c24-cba06d9dd3d9'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:36:26 devstack cinder-volume[86389]: WARNING cinder.quota [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-240055362 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-240055362, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:36:26 devstack cinder-volume[86389]: WARNING cinder.quota [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-240055362 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-240055362, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['c6b95754-b9eb-43b5-bbc3-af60f2dfc925', '82292846-0414-4bb1-babb-7bc27466b693', 'fcf01f37-a012-4d77-99cf-db9180915ca9', '249aca80-9be8-4c80-ae76-1e0b46199998'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:26 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:36:26 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] group_snapshot 96a25aba-abac-4325-a7e3-b964140d5c6e: deleting Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] group_snapshot 96a25aba-abac-4325-a7e3-b964140d5c6e: deleting {{(pid=86389) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-ac684a01-7052-4cdb-af2c-884e87cd709a" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-ac684a01-7052-4cdb-af2c-884e87cd709a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:36:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-5727630c-a8ed-4aa5-97ab-bc63d9fa0238" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:36:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-5727630c-a8ed-4aa5-97ab-bc63d9fa0238" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:36:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Deleting offline snapshot 5727630c-a8ed-4aa5-97ab-bc63d9fa0238 of volume ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:36:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] snapshot_file for this snap is: volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:36:27 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b48d2-9b14-44fd-8d52-94f08d315c53]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:27 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 Jul 05 19:36:27 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:27 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.868s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:27 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:36:27 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c30e45c1-96da-412b-a5e1-d6ee446f2d7c tempest-GroupSnapshotsTest-1567934627 None] Delete group completed successfully. Jul 05 19:36:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Acquiring lock "cinder-80335ab9-8ff2-4e46-afc8-1c292495e493-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:36:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Lock "cinder-80335ab9-8ff2-4e46-afc8-1c292495e493-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:36:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Acquiring lock "cinder-quobyte-80335ab9-8ff2-4e46-afc8-1c292495e493" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:36:28 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238" returned: 0 in 1.016s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac684a01-7052-4cdb-af2c-884e87cd709a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:36:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Lock "cinder-quobyte-80335ab9-8ff2-4e46-afc8-1c292495e493" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:36:28 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dc7387-60c3-41f3-9209-d3a6ce71892e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:28 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ece1c-78aa-475a-832c-c55ed86117bc]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:28 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a Jul 05 19:36:28 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:28 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 Jul 05 19:36:28 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:29 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493" returned: 0 in 0.895s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:29 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493 Jul 05 19:36:29 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:29 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a" returned: 0 in 0.964s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:29 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 Jul 05 19:36:29 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:30 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-80335ab9-8ff2-4e46-afc8-1c292495e493" returned: 0 in 0.983s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Lock "cinder-quobyte-80335ab9-8ff2-4e46-afc8-1c292495e493" released by "delete_volume" :: held 1.927s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:36:30 devstack cinder-volume[86389]: WARNING cinder.quota [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:36:30 devstack cinder-volume[86389]: WARNING cinder.quota [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Created reservations ['6b27db43-1a5c-4160-a32e-35c33ffee93d', '6e8933b4-bdb8-4ab1-8757-7b2b4bd31a86', 'eb3dfbf5-d141-4dff-bdc0-bcd23bdc036d', 'df611f50-733b-4cb4-9fc5-8ec6492a208d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:30 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:36:30 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:30 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238" returned: 0 in 1.171s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:30 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238 Jul 05 19:36:30 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:31 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.840s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:31 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:36:31 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Deleted volume successfully. Jul 05 19:36:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-51317baf-8ec6-47ba-85e9-df122fdbfda2 tempest-DeleteServersTestJSON-1514705528 None] Lock "cinder-80335ab9-8ff2-4e46-afc8-1c292495e493-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:36:31 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a.5727630c-a8ed-4aa5-97ab-bc63d9fa0238" returned: 0 in 0.916s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-5727630c-a8ed-4aa5-97ab-bc63d9fa0238" released by "_delete_snapshot" :: held 4.197s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:36:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-ac684a01-7052-4cdb-af2c-884e87cd709a" released by "delete_snapshot" :: held 4.238s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:36:31 devstack cinder-volume[86389]: WARNING cinder.quota [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-240055362 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-240055362, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:36:31 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['ccd5f99e-ba9a-466a-ac1e-f97a50d787a4', '1a8dce2c-54e3-4257-a10c-85a71f702700', '2c80c584-2f61-42a4-bdda-a91c66468a7e', '200233a8-9f12-4986-906c-2071142cf45e'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:36:31 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ab16b9e0-f840-4312-9c5e-2d259e9d8e2d tempest-GroupSnapshotsTest-1567934627 None] group_snapshot 96a25aba-abac-4325-a7e3-b964140d5c6e: deleted successfully Jul 05 19:36:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-ac684a01-7052-4cdb-af2c-884e87cd709a" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:36:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-ac684a01-7052-4cdb-af2c-884e87cd709a" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:36:32 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0ab084-d54d-4d40-a2a4-53105ae436a7]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:32 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a Jul 05 19:36:32 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:33 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a" returned: 0 in 0.907s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:33 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a Jul 05 19:36:33 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:34 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ac684a01-7052-4cdb-af2c-884e87cd709a" returned: 0 in 1.205s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-ac684a01-7052-4cdb-af2c-884e87cd709a" released by "delete_volume" :: held 2.232s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['1bcdb0ce-ea42-4284-809f-39aa027ac6e0'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:36:34 devstack cinder-volume[86389]: WARNING cinder.db.api [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-240055362'] Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['1995fbfa-6f01-4a5b-9151-332e3c7ef49e', '5d03d109-f71b-45aa-a74c-09c7c4c7a105', 'c3de9111-4bff-4d47-9196-3d79a858ff9b', '8d110fae-6d5c-4780-806f-bed4c527ab7c'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:34 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:36:34 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.016s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:35 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:36:35 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b459a343-f956-4d35-b141-610891171183 tempest-GroupSnapshotsTest-1567934627 None] Delete group completed successfully. Jul 05 19:36:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fc5a0cd6-8bc2-455a-a08c-f1e6d8820274 tempest-GroupSnapshotsTest-1567934627 None] Group tempest-GroupSnapshotsTest-Group-816140257: creating Jul 05 19:36:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fc5a0cd6-8bc2-455a-a08c-f1e6d8820274 tempest-GroupSnapshotsTest-1567934627 None] Group tempest-GroupSnapshotsTest-Group-816140257: created successfully Jul 05 19:36:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fc5a0cd6-8bc2-455a-a08c-f1e6d8820274 tempest-GroupSnapshotsTest-1567934627 None] Create group completed successfully. Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Flow 'volume_create_manager' (e2871e8f-3700-4aad-9dc1-28033dec35ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7903d10-dbc6-4fd4-a25e-059b86c394b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7903d10-dbc6-4fd4-a25e-059b86c394b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966608582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78152dd0-a2ad-4ff3-938a-e775fe324cc1,host='devstack@QuobyteHD#QuobyteHD',id=9c491c42-3235-4b46-b85a-8fef4664ebe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34d039952bb455e92348483ca0dd45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:36:38Z,use_quota=True,user_id='011b6a647f524a3598aebe3c0714f64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2564eed9-70ad-4141-b815-e19bc72101df),volume_type_id=2564eed9-70ad-4141-b815-e19bc72101df)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef63095-b99d-41c9-bd21-a7d8ce8d39d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef63095-b99d-41c9-bd21-a7d8ce8d39d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beddb55b-63e0-4f4e-bda8-e99557ac0b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beddb55b-63e0-4f4e-bda8-e99557ac0b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c491c42-3235-4b46-b85a-8fef4664ebe3', 'volume_name': 'volume-9c491c42-3235-4b46-b85a-8fef4664ebe3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1872662a-5632-495f-8c08-6a8f114a7abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1872662a-5632-495f-8c08-6a8f114a7abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b68939-276b-4fc2-bb37-b94a3e55a0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:37 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Volume 9c491c42-3235-4b46-b85a-8fef4664ebe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c491c42-3235-4b46-b85a-8fef4664ebe3', 'volume_size': 1} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78152dd0-a2ad-4ff3-938a-e775fe324cc1,created_at=2026-07-05T17:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966608582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78152dd0-a2ad-4ff3-938a-e775fe324cc1,host='devstack@QuobyteHD#QuobyteHD',id=9c491c42-3235-4b46-b85a-8fef4664ebe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34d039952bb455e92348483ca0dd45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:36:38Z,use_quota=True,user_id='011b6a647f524a3598aebe3c0714f64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2564eed9-70ad-4141-b815-e19bc72101df),volume_type_id=2564eed9-70ad-4141-b815-e19bc72101df)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Creating volume 9c491c42-3235-4b46-b85a-8fef4664ebe3 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:36:37 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:36:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:37 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 1073741824 Jul 05 19:36:37 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:38 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 1073741824" returned: 0 in 1.065s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:39 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 Jul 05 19:36:39 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:39 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3" returned: 0 in 0.762s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:36:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b68939-276b-4fc2-bb37-b94a3e55a0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c491c42-3235-4b46-b85a-8fef4664ebe3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ab9c89-6413-48d9-a6f9-e2efe43302ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:39 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Volume volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 (9c491c42-3235-4b46-b85a-8fef4664ebe3): created successfully Jul 05 19:36:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ab9c89-6413-48d9-a6f9-e2efe43302ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Flow 'volume_create_manager' (e2871e8f-3700-4aad-9dc1-28033dec35ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:36:39 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-845470a7-623f-4e16-b1e2-d6c7ff891cf7 tempest-GroupSnapshotsTest-1567934627 None] Created volume successfully. Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Flow 'volume_create_manager' (f6b291c9-2c56-41c9-aa80-1f5c762bd443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61148590-bb30-4740-b098-782a2be157b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61148590-bb30-4740-b098-782a2be157b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562435732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78152dd0-a2ad-4ff3-938a-e775fe324cc1,host='devstack@QuobyteHD#QuobyteHD',id=dcac6033-83da-4293-901b-ba3b15a048dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34d039952bb455e92348483ca0dd45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:36:41Z,use_quota=True,user_id='011b6a647f524a3598aebe3c0714f64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2564eed9-70ad-4141-b815-e19bc72101df),volume_type_id=2564eed9-70ad-4141-b815-e19bc72101df)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd22f66-ff39-4423-a8a6-7105f1966862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd22f66-ff39-4423-a8a6-7105f1966862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc23880-5b06-4a7d-8229-bbeb0791fee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc23880-5b06-4a7d-8229-bbeb0791fee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcac6033-83da-4293-901b-ba3b15a048dc', 'volume_name': 'volume-dcac6033-83da-4293-901b-ba3b15a048dc', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239c0095-49d2-432d-8b17-c5e493493362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239c0095-49d2-432d-8b17-c5e493493362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8751124-d796-48e2-bb97-24d47ef30d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:40 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Volume dcac6033-83da-4293-901b-ba3b15a048dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcac6033-83da-4293-901b-ba3b15a048dc', 'volume_size': 1} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78152dd0-a2ad-4ff3-938a-e775fe324cc1,created_at=2026-07-05T17:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562435732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78152dd0-a2ad-4ff3-938a-e775fe324cc1,host='devstack@QuobyteHD#QuobyteHD',id=dcac6033-83da-4293-901b-ba3b15a048dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34d039952bb455e92348483ca0dd45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:36:41Z,use_quota=True,user_id='011b6a647f524a3598aebe3c0714f64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2564eed9-70ad-4141-b815-e19bc72101df),volume_type_id=2564eed9-70ad-4141-b815-e19bc72101df)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Creating volume dcac6033-83da-4293-901b-ba3b15a048dc {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:36:40 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:36:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:40 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc 1073741824 Jul 05 19:36:40 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:41 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc 1073741824" returned: 0 in 0.967s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:41 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc Jul 05 19:36:41 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:42 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc" returned: 0 in 0.735s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:36:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8751124-d796-48e2-bb97-24d47ef30d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcac6033-83da-4293-901b-ba3b15a048dc', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a5ef75-5a04-41e4-a1ec-93d32fd5dc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:36:42 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Volume volume-dcac6033-83da-4293-901b-ba3b15a048dc (dcac6033-83da-4293-901b-ba3b15a048dc): created successfully Jul 05 19:36:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a5ef75-5a04-41e4-a1ec-93d32fd5dc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:36:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Flow 'volume_create_manager' (f6b291c9-2c56-41c9-aa80-1f5c762bd443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:36:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c6a44772-2bc7-48a2-b55e-08a2d5039404 tempest-GroupSnapshotsTest-1567934627 None] Created volume successfully. Jul 05 19:36:43 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f57d3e26-ff10-4dc1-96a4-59bfe8159a62 tempest-GroupSnapshotsTest-1567934627 None] Update group completed successfully. Jul 05 19:36:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-bbf321c3-0084-4b08-9f61-5ffb3ebefea3 tempest-GroupSnapshotsTest-1567934627 None] Update group completed successfully. Jul 05 19:36:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-44997a87-b658-4a5b-a18d-b16a605ec478 tempest-GroupSnapshotsTest-1567934627 None] Update group completed successfully. Jul 05 19:36:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2ba37ce8-e7b4-44fd-8e8e-929d10a5f7e0 tempest-GroupSnapshotsTest-1567934627 None] Update group completed successfully. Jul 05 19:36:49 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] GroupSnapshot ca8e95e0-2808-4be4-8e0d-18617441c01b: creating. Jul 05 19:36:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Group snapshot ca8e95e0-2808-4be4-8e0d-18617441c01b: creating. {{(pid=86389) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 19:36:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:49 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=72,cinder:UPDATE=66,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:36:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Creating offline snapshot 63b4a849-da30-401b-b0c2-907115799e59 of volume 9c491c42-3235-4b46-b85a-8fef4664ebe3 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:36:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ceae06-a29c-439e-a319-18a4e0e20d00]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:49 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 Jul 05 19:36:49 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:50 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3" returned: 0 in 0.977s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:50 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 1G Jul 05 19:36:50 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:51 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 1G" returned: 0 in 0.952s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:51 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 Jul 05 19:36:51 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:51 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59" returned: 0 in 0.785s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:51 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:36:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:51 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 Jul 05 19:36:51 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:52 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:52 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=66,cinder:UPDATE=56,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:36:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:52 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.info Jul 05 19:36:52 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:53 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.info" returned: 0 in 0.864s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:53 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:36:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:53 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.info Jul 05 19:36:53 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:54 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.info" returned: 0 in 0.885s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.297s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:36:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:36:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:36:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Creating offline snapshot 909f528e-a671-4058-ae50-c511e30a5720 of volume dcac6033-83da-4293-901b-ba3b15a048dc {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:36:54 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b170b398-d61f-4f07-a88e-8cd938619aaa]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:36:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-7d1ba47e-66e8-43da-912a-a24ad523a735 req-d2eec897-1746-4405-84fc-115031346717 tempest-AttachVolumeShelveTestJSON-1102601362 None] No connector for attachment 50f505dd-b345-4688-ab0f-8fb44d14e745; skipping storage backend terminate_connection call. {{(pid=86389) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 05 19:36:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-7d1ba47e-66e8-43da-912a-a24ad523a735 req-d2eec897-1746-4405-84fc-115031346717 tempest-AttachVolumeShelveTestJSON-1102601362 None] Deleting attachment 50f505dd-b345-4688-ab0f-8fb44d14e745. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:36:54 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc Jul 05 19:36:54 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:55 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc" returned: 0 in 0.924s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:55 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 1G Jul 05 19:36:55 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:56 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 1G" returned: 0 in 1.093s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcac6033-83da-4293-901b-ba3b15a048dc -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:56 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcac6033-83da-4293-901b-ba3b15a048dc -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 Jul 05 19:36:56 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:57 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcac6033-83da-4293-901b-ba3b15a048dc -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720" returned: 0 in 1.202s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:57 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:36:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:57 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 Jul 05 19:36:57 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:58 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720" returned: 0 in 0.716s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:58 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.info Jul 05 19:36:58 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:36:59 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Jul 05 19:36:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.info" returned: 0 in 0.752s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:36:59 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:36:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:36:59 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.info Jul 05 19:36:59 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:00 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.info" returned: 0 in 0.820s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.646s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:00 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-17a1f66b-3640-4e0d-87e5-216c7b2c7784 tempest-GroupSnapshotsTest-1567934627 None] group_snapshot ca8e95e0-2808-4be4-8e0d-18617441c01b: created successfully Jul 05 19:37:00 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] group_snapshot ca8e95e0-2808-4be4-8e0d-18617441c01b: deleting Jul 05 19:37:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] group_snapshot ca8e95e0-2808-4be4-8e0d-18617441c01b: deleting {{(pid=86389) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 19:37:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-9c491c42-3235-4b46-b85a-8fef4664ebe3" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-9c491c42-3235-4b46-b85a-8fef4664ebe3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-63b4a849-da30-401b-b0c2-907115799e59" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-63b4a849-da30-401b-b0c2-907115799e59" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Deleting offline snapshot 63b4a849-da30-401b-b0c2-907115799e59 of volume 9c491c42-3235-4b46-b85a-8fef4664ebe3 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] snapshot_file for this snap is: volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c60227-ecb9-404e-bbdf-3f554d8bae88]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:01 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 Jul 05 19:37:01 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:01 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59" returned: 0 in 0.798s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c491c42-3235-4b46-b85a-8fef4664ebe3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[670c9751-fd5c-41fd-a830-d215e906e770]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:01 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 Jul 05 19:37:02 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:02 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3" returned: 0 in 0.813s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:02 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 Jul 05 19:37:02 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:03 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59" returned: 0 in 0.777s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:03 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59 Jul 05 19:37:03 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:04 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3.63b4a849-da30-401b-b0c2-907115799e59" returned: 0 in 0.674s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-63b4a849-da30-401b-b0c2-907115799e59" released by "_delete_snapshot" :: held 3.201s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-9c491c42-3235-4b46-b85a-8fef4664ebe3" released by "delete_snapshot" :: held 3.231s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-dcac6033-83da-4293-901b-ba3b15a048dc" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-dcac6033-83da-4293-901b-ba3b15a048dc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-909f528e-a671-4058-ae50-c511e30a5720" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-909f528e-a671-4058-ae50-c511e30a5720" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Deleting offline snapshot 909f528e-a671-4058-ae50-c511e30a5720 of volume dcac6033-83da-4293-901b-ba3b15a048dc {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] snapshot_file for this snap is: volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6239522-416e-4ba8-8856-9e387723a4ba]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:04 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 Jul 05 19:37:04 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:05 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720" returned: 0 in 1.022s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcac6033-83da-4293-901b-ba3b15a048dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:37:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe63cc8d-cf72-4b7c-9e95-f84793ea9532]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:05 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc Jul 05 19:37:05 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:06 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc" returned: 0 in 0.829s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:06 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 Jul 05 19:37:06 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:07 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720" returned: 0 in 0.850s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:07 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720 Jul 05 19:37:07 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:07 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc.909f528e-a671-4058-ae50-c511e30a5720" returned: 0 in 0.667s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-909f528e-a671-4058-ae50-c511e30a5720" released by "_delete_snapshot" :: held 3.494s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-dcac6033-83da-4293-901b-ba3b15a048dc" released by "delete_snapshot" :: held 3.519s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:07 devstack cinder-volume[86389]: WARNING cinder.quota [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1235373215 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1235373215, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:37:07 devstack cinder-volume[86389]: WARNING cinder.quota [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1235373215 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1235373215, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:37:07 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['a124ee36-6ab5-44e7-b3c1-0f9fb936ebc4', '4ea994d1-164e-4a03-a3a6-8ef672a926f0', '20ab8276-4fa7-4910-992c-440b31814cb7', '4c491ced-5ac8-464c-82a4-ec13b8d6282c'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:37:08 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['add84b04-3abc-4308-8225-dbb35b2da6eb', 'ec31bb88-8e30-41d8-9a7a-bbea54c30ba8', 'b01cb83d-30dc-42fc-954a-9113ca68f830', '99f6c0dd-d567-499d-9650-4ea48c756abc'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:37:08 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-aac67baa-978e-4581-9f34-4316160c9bf2 tempest-GroupSnapshotsTest-1567934627 None] group_snapshot ca8e95e0-2808-4be4-8e0d-18617441c01b: deleted successfully Jul 05 19:37:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-9c491c42-3235-4b46-b85a-8fef4664ebe3" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-9c491c42-3235-4b46-b85a-8fef4664ebe3" acquired by "delete_volume" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:09 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e64c540-a08b-41ef-bb23-5b79cf25685b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:09 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 Jul 05 19:37:09 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:10 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3" returned: 0 in 1.502s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:10 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3 Jul 05 19:37:10 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:11 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c491c42-3235-4b46-b85a-8fef4664ebe3" returned: 0 in 1.271s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-9c491c42-3235-4b46-b85a-8fef4664ebe3" released by "delete_volume" :: held 2.860s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-dcac6033-83da-4293-901b-ba3b15a048dc" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-dcac6033-83da-4293-901b-ba3b15a048dc" acquired by "delete_volume" :: waited 0.039s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:11 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee1321b-9396-4882-bd1f-2d49e20b4f6a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:12 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc Jul 05 19:37:12 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:13 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc" returned: 0 in 1.346s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:13 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc Jul 05 19:37:13 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:14 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcac6033-83da-4293-901b-ba3b15a048dc" returned: 0 in 1.060s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-dcac6033-83da-4293-901b-ba3b15a048dc" released by "delete_volume" :: held 2.542s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:14 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['4cdaedad-19c4-4cad-bf49-5c06ae224f31'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:37:14 devstack cinder-volume[86389]: WARNING cinder.quota [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1235373215 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1235373215, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:37:14 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['29ae4a6a-9e55-4595-b8f0-e78e6e789c81', '4b8e13ac-3381-4380-8afd-3f92c23fde6e', 'd14dee53-d3c8-40db-bd06-5e856efb4235', 'd8a69213-bef2-455b-9641-2c9d3b3993c6'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:37:15 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['f005b59d-b9f2-490d-9d8e-12dafe303ed7', 'a9c7341e-f539-49b6-9f73-c3952e050abf', '28ccb627-538f-4685-a4c9-8503bb3ae208', '2d94583b-9395-44f7-9686-09bf615dd782'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:37:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:37:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:37:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:15 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:37:15 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:16 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:37:16 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:16 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.658s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:37:16 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a75321cf-63c1-4c57-a198-17e2f56b5276 tempest-GroupSnapshotsTest-1567934627 None] Delete group completed successfully. Jul 05 19:37:16 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Flow 'volume_create_manager' (b778b875-e3a3-4091-a7d8-7d6e05949d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cc50b8-f507-4ab2-8069-47614159b5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cc50b8-f507-4ab2-8069-47614159b5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1889798916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d43bc5e-e436-4dbc-b62d-02a610bafb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cd4493d962409c998b70ae0a6ed298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:37:17Z,use_quota=True,user_id='d3627a9758694d6cbf0f16c4b6db640b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb74361-9de7-4f74-bbf0-a85340d5dc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb74361-9de7-4f74-bbf0-a85340d5dc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4f3c46-83e7-46b3-8ae1-4929a4635f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4f3c46-83e7-46b3-8ae1-4929a4635f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d43bc5e-e436-4dbc-b62d-02a610bafb69', 'volume_name': 'volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cc9dae-f29d-41e7-8238-aa75ef1b6d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cc9dae-f29d-41e7-8238-aa75ef1b6d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66de2b9e-7de3-4441-b634-4bcaa7b3ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:17 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Volume 0d43bc5e-e436-4dbc-b62d-02a610bafb69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69', 'volume_size': 1} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1889798916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d43bc5e-e436-4dbc-b62d-02a610bafb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cd4493d962409c998b70ae0a6ed298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:37:17Z,use_quota=True,user_id='d3627a9758694d6cbf0f16c4b6db640b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Creating volume 0d43bc5e-e436-4dbc-b62d-02a610bafb69 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:37:17 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6e7a90f7-8065-4b7f-90c3-5d786edc08f7 tempest-GroupSnapshotsTest-1567934627 None] Group tempest-GroupSnapshotsTest-Group-269423219: creating Jul 05 19:37:17 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 1073741824 Jul 05 19:37:17 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6e7a90f7-8065-4b7f-90c3-5d786edc08f7 tempest-GroupSnapshotsTest-1567934627 None] Group tempest-GroupSnapshotsTest-Group-269423219: created successfully Jul 05 19:37:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6e7a90f7-8065-4b7f-90c3-5d786edc08f7 tempest-GroupSnapshotsTest-1567934627 None] Create group completed successfully. Jul 05 19:37:17 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.443s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 8 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:37:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:37:18 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 1073741824" returned: 0 in 1.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:19 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 Jul 05 19:37:19 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Flow 'volume_create_manager' (93336042-a6a9-48c3-b3ea-82d683fb57d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c7dd7c-1e9a-4f74-8a5f-ac33c693d882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c7dd7c-1e9a-4f74-8a5f-ac33c693d882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-526743408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0317c9b-f00a-48a2-a96c-b4b06b081941,host='devstack@QuobyteHD#QuobyteHD',id=fc142191-e2ab-418d-9386-5ef53844bc66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34d039952bb455e92348483ca0dd45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:37:20Z,use_quota=True,user_id='011b6a647f524a3598aebe3c0714f64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29932cc3-1b55-4ce4-b737-f6a3c305dcf9),volume_type_id=29932cc3-1b55-4ce4-b737-f6a3c305dcf9)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e368216e-05aa-4a50-88c6-609b838e0532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e368216e-05aa-4a50-88c6-609b838e0532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b4121e-4af3-432e-bb4c-c527b6690d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b4121e-4af3-432e-bb4c-c527b6690d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc142191-e2ab-418d-9386-5ef53844bc66', 'volume_name': 'volume-fc142191-e2ab-418d-9386-5ef53844bc66', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9536143-bf52-49ae-9679-21e3b0173213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9536143-bf52-49ae-9679-21e3b0173213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e573e3cb-192e-4ac1-a091-45fdaf619f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:20 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Volume fc142191-e2ab-418d-9386-5ef53844bc66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc142191-e2ab-418d-9386-5ef53844bc66', 'volume_size': 1} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:20 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69" returned: 0 in 1.659s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] <== create_volume: return (3491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.494s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0317c9b-f00a-48a2-a96c-b4b06b081941,created_at=2026-07-05T17:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-526743408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0317c9b-f00a-48a2-a96c-b4b06b081941,host='devstack@QuobyteHD#QuobyteHD',id=fc142191-e2ab-418d-9386-5ef53844bc66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34d039952bb455e92348483ca0dd45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:37:20Z,use_quota=True,user_id='011b6a647f524a3598aebe3c0714f64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29932cc3-1b55-4ce4-b737-f6a3c305dcf9),volume_type_id=29932cc3-1b55-4ce4-b737-f6a3c305dcf9)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Creating volume fc142191-e2ab-418d-9386-5ef53844bc66 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:37:20 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66de2b9e-7de3-4441-b634-4bcaa7b3ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:20 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 1073741824 Jul 05 19:37:20 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b258aa-75ed-45df-a89c-32183879f076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:20 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Volume volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 (0d43bc5e-e436-4dbc-b62d-02a610bafb69): created successfully Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b258aa-75ed-45df-a89c-32183879f076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Flow 'volume_create_manager' (b778b875-e3a3-4091-a7d8-7d6e05949d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:37:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0012057f-8eab-4cc8-932a-02729b930de7 tempest-VolumesAdminNegativeTest-2057431745 None] Created volume successfully. Jul 05 19:37:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 1073741824" returned: 0 in 1.337s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:21 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Acquiring lock "cinder-0d43bc5e-e436-4dbc-b62d-02a610bafb69-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:22 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 Jul 05 19:37:22 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Lock "cinder-0d43bc5e-e436-4dbc-b62d-02a610bafb69-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Acquiring lock "cinder-quobyte-0d43bc5e-e436-4dbc-b62d-02a610bafb69" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Lock "cinder-quobyte-0d43bc5e-e436-4dbc-b62d-02a610bafb69" acquired by "delete_volume" :: waited 0.058s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0cd118-27af-4c92-a6c9-c2a0065ebf87]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:23 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 Jul 05 19:37:23 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:25 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69" returned: 0 in 2.159s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:25 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69 Jul 05 19:37:25 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:25 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66" returned: 0 in 2.962s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] <== create_volume: return (4562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:37:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.564s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e573e3cb-192e-4ac1-a091-45fdaf619f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc142191-e2ab-418d-9386-5ef53844bc66', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0ab597-217b-4d12-8569-cab32aabb1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:25 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Volume volume-fc142191-e2ab-418d-9386-5ef53844bc66 (fc142191-e2ab-418d-9386-5ef53844bc66): created successfully Jul 05 19:37:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0ab597-217b-4d12-8569-cab32aabb1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Flow 'volume_create_manager' (93336042-a6a9-48c3-b3ea-82d683fb57d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:37:25 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-693f20c0-5af5-4568-91d8-152cd154680b tempest-GroupSnapshotsTest-1567934627 None] Created volume successfully. Jul 05 19:37:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] GroupSnapshot ea111a49-cb1e-49c4-8d09-e9d79b20e1b3: creating. Jul 05 19:37:26 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0d43bc5e-e436-4dbc-b62d-02a610bafb69" returned: 0 in 1.377s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Lock "cinder-quobyte-0d43bc5e-e436-4dbc-b62d-02a610bafb69" released by "delete_volume" :: held 3.732s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Group snapshot ea111a49-cb1e-49c4-8d09-e9d79b20e1b3: creating. {{(pid=86389) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 19:37:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Creating offline snapshot 48cb30ba-5bd7-488b-b09c-6763c138c17c of volume fc142191-e2ab-418d-9386-5ef53844bc66 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:37:26 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4fa8ca-5075-409d-882d-2505ba448d75]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:26 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Created reservations ['a70ac749-f672-4c1b-a320-3dbdad73630e', '312943e2-1153-4006-ac30-7b4f7af6e27f', '59713465-00c3-4e6e-a269-c32016868ccf', '19d61b84-4533-4abd-8178-75fca12ea177'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:37:27 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 Jul 05 19:37:27 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:37:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:37:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:27 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:37:27 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:28 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.457s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:28 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:37:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Deleted volume successfully. Jul 05 19:37:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d6735ecb-1325-4cc9-b9c8-cf1f5003c52e tempest-VolumesAdminNegativeTest-2057431745 None] Lock "cinder-0d43bc5e-e436-4dbc-b62d-02a610bafb69-delete_volume" released by "delete_volume" :: held 6.244s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:28 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66" returned: 0 in 2.201s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:29 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c 1G Jul 05 19:37:29 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:30 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c 1G" returned: 0 in 1.945s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc142191-e2ab-418d-9386-5ef53844bc66 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:31 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc142191-e2ab-418d-9386-5ef53844bc66 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c Jul 05 19:37:31 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:32 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc142191-e2ab-418d-9386-5ef53844bc66 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c" returned: 0 in 1.637s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:32 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:37:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:32 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c Jul 05 19:37:32 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:33 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c" returned: 0 in 0.813s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:33 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.info Jul 05 19:37:33 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:34 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.info" returned: 0 in 1.014s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:34 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:37:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:34 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.info Jul 05 19:37:34 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:35 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.info" returned: 0 in 0.737s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.530s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-362c9ab6-4002-4b42-bda7-cd39cac1b245 tempest-GroupSnapshotsTest-1567934627 None] group_snapshot ea111a49-cb1e-49c4-8d09-e9d79b20e1b3: created successfully Jul 05 19:37:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] group_snapshot ea111a49-cb1e-49c4-8d09-e9d79b20e1b3: deleting Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] group_snapshot ea111a49-cb1e-49c4-8d09-e9d79b20e1b3: deleting {{(pid=86389) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-fc142191-e2ab-418d-9386-5ef53844bc66" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-fc142191-e2ab-418d-9386-5ef53844bc66" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-48cb30ba-5bd7-488b-b09c-6763c138c17c" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-48cb30ba-5bd7-488b-b09c-6763c138c17c" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Deleting offline snapshot 48cb30ba-5bd7-488b-b09c-6763c138c17c of volume fc142191-e2ab-418d-9386-5ef53844bc66 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] snapshot_file for this snap is: volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a58a26-3337-460e-8a8b-a3914a7e6961]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:36 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c Jul 05 19:37:36 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:36 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c" returned: 0 in 0.983s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc142191-e2ab-418d-9386-5ef53844bc66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:37:36 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6d211-e936-4a41-8af1-d6996b5934dc]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:37 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 Jul 05 19:37:37 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:37 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66" returned: 0 in 0.937s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:37 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c Jul 05 19:37:37 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:39 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c" returned: 0 in 1.187s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:39 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c Jul 05 19:37:39 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:39 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66.48cb30ba-5bd7-488b-b09c-6763c138c17c" returned: 0 in 0.937s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-48cb30ba-5bd7-488b-b09c-6763c138c17c" released by "_delete_snapshot" :: held 4.191s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-fc142191-e2ab-418d-9386-5ef53844bc66" released by "delete_snapshot" :: held 4.244s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:40 devstack cinder-volume[86389]: WARNING cinder.quota [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1682827915 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1682827915, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:37:40 devstack cinder-volume[86389]: WARNING cinder.quota [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1682827915 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1682827915, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:37:40 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['4c73b6f7-0a39-4040-8c9c-16ac99b634d0', '9d6b0037-f407-4fde-9329-912a313e43d4', 'af9615d4-1405-4fbf-a6bf-8390f09ee6b1', 'c0c33f15-fc6c-48f5-9598-df9ed7212f9d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:37:40 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c0672053-1f14-4e95-936b-15dd0c02eba0 tempest-GroupSnapshotsTest-1567934627 None] group_snapshot ea111a49-cb1e-49c4-8d09-e9d79b20e1b3: deleted successfully Jul 05 19:37:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "cinder-quobyte-fc142191-e2ab-418d-9386-5ef53844bc66" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:37:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-fc142191-e2ab-418d-9386-5ef53844bc66" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:37:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[61328c5a-ffec-440b-a4a5-4cbac08b8e0c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:37:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:41 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 Jul 05 19:37:41 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:41 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66" returned: 0 in 1.181s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:42 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66 Jul 05 19:37:42 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:43 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc142191-e2ab-418d-9386-5ef53844bc66" returned: 0 in 1.296s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Lock "cinder-quobyte-fc142191-e2ab-418d-9386-5ef53844bc66" released by "delete_volume" :: held 2.574s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['249158c5-16da-45c8-afde-ddddb005d877'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:37:43 devstack cinder-volume[86389]: WARNING cinder.quota [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1682827915 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1682827915, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Created reservations ['232e800d-98ff-4cd4-abc1-997021864595', '91914a03-71a7-4e63-9f45-96a0b8b76d3c', 'c21cb1ed-c165-49c6-9776-c706998047f0', '0d3ea4fb-aa8c-4de4-98c6-944198ef34b7'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:43 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:37:43 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Flow 'volume_create_manager' (807cb770-36f0-42df-9227-4e0b133a61e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d140d157-50ca-4421-89fe-d3c21c057c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d140d157-50ca-4421-89fe-d3c21c057c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-669475173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148823bd-24df-48c4-ac77-ab239cbac389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a9c8fc6fa44c0fbe9ca6f0613371f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:37:44Z,use_quota=True,user_id='ee9ca6c722424bad96be955b35ef8cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d04bea7-7b8c-4893-849d-7ff55b56544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d04bea7-7b8c-4893-849d-7ff55b56544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d132613-9f95-471f-9df5-bd0c81c52675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d132613-9f95-471f-9df5-bd0c81c52675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '148823bd-24df-48c4-ac77-ab239cbac389', 'volume_name': 'volume-148823bd-24df-48c4-ac77-ab239cbac389', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ea420b-5677-41c0-a091-67a73457c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ea420b-5677-41c0-a091-67a73457c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292a71fc-9c40-4383-875e-b17478b3d773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:44 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Volume 148823bd-24df-48c4-ac77-ab239cbac389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-148823bd-24df-48c4-ac77-ab239cbac389', 'volume_size': 1} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-669475173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148823bd-24df-48c4-ac77-ab239cbac389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a9c8fc6fa44c0fbe9ca6f0613371f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:37:44Z,use_quota=True,user_id='ee9ca6c722424bad96be955b35ef8cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Creating volume 148823bd-24df-48c4-ac77-ab239cbac389 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:37:44 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:44 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389 1073741824 Jul 05 19:37:44 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:44 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.027s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:44 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:37:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-85fd31bc-d6e5-4b9f-a554-280e71e5277f tempest-GroupSnapshotsTest-1567934627 None] Delete group completed successfully. Jul 05 19:37:45 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389 1073741824" returned: 0 in 1.312s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:45 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389 Jul 05 19:37:45 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:46 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389" returned: 0 in 1.299s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] <== create_volume: return (2683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:37:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.685s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292a71fc-9c40-4383-875e-b17478b3d773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-148823bd-24df-48c4-ac77-ab239cbac389', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb212d6-bc12-4ddb-8cc1-7cee0203a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:47 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Volume volume-148823bd-24df-48c4-ac77-ab239cbac389 (148823bd-24df-48c4-ac77-ab239cbac389): created successfully Jul 05 19:37:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb212d6-bc12-4ddb-8cc1-7cee0203a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Flow 'volume_create_manager' (807cb770-36f0-42df-9227-4e0b133a61e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:37:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-14eb923d-6ffc-46aa-901f-d53c5ddcdc61 tempest-ServerRescueNegativeTestJSON-884971459 None] Created volume successfully. Jul 05 19:37:53 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=65,cinder:UPDATE=74,cinder:INSERT=22,cinder:DELETE=3 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:37:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-44717706-99ff-4e8d-ab92-5c7eabaf268f tempest-GroupsTest-1471472897 None] Group tempest-Group1-204131970: creating Jul 05 19:37:53 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=70,cinder:SELECT=68,cinder:INSERT=14,cinder:DELETE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:37:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-44717706-99ff-4e8d-ab92-5c7eabaf268f tempest-GroupsTest-1471472897 None] Group tempest-Group1-204131970: created successfully Jul 05 19:37:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-44717706-99ff-4e8d-ab92-5c7eabaf268f tempest-GroupsTest-1471472897 None] Create group completed successfully. Jul 05 19:37:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-32976458-fa6e-4ee0-b4d2-4019bd317abb tempest-GroupsTest-1471472897 None] Group tempest-Group2-619013165: creating Jul 05 19:37:55 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-32976458-fa6e-4ee0-b4d2-4019bd317abb tempest-GroupsTest-1471472897 None] Group tempest-Group2-619013165: created successfully Jul 05 19:37:55 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-32976458-fa6e-4ee0-b4d2-4019bd317abb tempest-GroupsTest-1471472897 None] Create group completed successfully. Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Flow 'volume_create_manager' (b463cecb-59d5-433e-ae0a-33a3d1a336b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f84bb6-f3fd-445a-8892-aed6e8dd42c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f84bb6-f3fd-445a-8892-aed6e8dd42c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-959058419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=573edb0a-7f32-4bb8-b853-1e1c5bd5da06,host='devstack@QuobyteHD#QuobyteHD',id=a88c2f58-e146-42a9-9198-4e401d882a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2bfc963f584f0880917079566c76dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:37:57Z,use_quota=True,user_id='459e476161d94fa1bf1a5a3657d8a6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ee76cbb-a5fd-4505-87a2-c555180382e1),volume_type_id=6ee76cbb-a5fd-4505-87a2-c555180382e1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a26b82-bc98-497c-a645-414f6d52de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a26b82-bc98-497c-a645-414f6d52de3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9984455b-e7f7-45a3-ba0e-88a93d8addf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9984455b-e7f7-45a3-ba0e-88a93d8addf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88c2f58-e146-42a9-9198-4e401d882a3c', 'volume_name': 'volume-a88c2f58-e146-42a9-9198-4e401d882a3c', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a52589-2fed-4002-97d1-c3f9227088c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a52589-2fed-4002-97d1-c3f9227088c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a2165d-679f-415b-82dd-fc59387bf173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:56 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Volume a88c2f58-e146-42a9-9198-4e401d882a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88c2f58-e146-42a9-9198-4e401d882a3c', 'volume_size': 1} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=573edb0a-7f32-4bb8-b853-1e1c5bd5da06,created_at=2026-07-05T17:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-959058419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=573edb0a-7f32-4bb8-b853-1e1c5bd5da06,host='devstack@QuobyteHD#QuobyteHD',id=a88c2f58-e146-42a9-9198-4e401d882a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2bfc963f584f0880917079566c76dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:37:57Z,use_quota=True,user_id='459e476161d94fa1bf1a5a3657d8a6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ee76cbb-a5fd-4505-87a2-c555180382e1),volume_type_id=6ee76cbb-a5fd-4505-87a2-c555180382e1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Creating volume a88c2f58-e146-42a9-9198-4e401d882a3c {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:37:56 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:37:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:56 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c 1073741824 Jul 05 19:37:56 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:57 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c 1073741824" returned: 0 in 0.987s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:37:57 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c Jul 05 19:37:57 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:37:58 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Jul 05 19:37:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c" returned: 0 in 0.890s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:37:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:37:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:37:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a2165d-679f-415b-82dd-fc59387bf173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88c2f58-e146-42a9-9198-4e401d882a3c', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c10a08c-f0ca-4687-af79-ac334737a594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:37:58 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Volume volume-a88c2f58-e146-42a9-9198-4e401d882a3c (a88c2f58-e146-42a9-9198-4e401d882a3c): created successfully Jul 05 19:37:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c10a08c-f0ca-4687-af79-ac334737a594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:37:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Flow 'volume_create_manager' (b463cecb-59d5-433e-ae0a-33a3d1a336b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:37:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-52a94a92-b502-4aed-8a5e-eabb98b411d9 tempest-GroupsTest-1471472897 None] Created volume successfully. Jul 05 19:37:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Acquiring lock "cinder-quobyte-a88c2f58-e146-42a9-9198-4e401d882a3c" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Lock "cinder-quobyte-a88c2f58-e146-42a9-9198-4e401d882a3c" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:00 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d3160-2f3d-4f5e-b401-0186b1dfdf43]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:38:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:00 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c Jul 05 19:38:00 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:01 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c" returned: 0 in 0.993s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:01 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c Jul 05 19:38:01 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:02 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a88c2f58-e146-42a9-9198-4e401d882a3c" returned: 0 in 1.092s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Lock "cinder-quobyte-a88c2f58-e146-42a9-9198-4e401d882a3c" released by "delete_volume" :: held 2.148s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Created reservations ['8096624b-7ec7-4f9b-930f-5dbc4afb92fd'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:02 devstack cinder-volume[86389]: WARNING cinder.quota [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1721236094 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1721236094, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:38:02 devstack cinder-volume[86389]: WARNING cinder.quota [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1721236094 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1721236094, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Created reservations ['019359f8-6d9a-410f-8d47-1ccfc1ee15a4', '7ac0f79e-bc1d-49cd-bbe8-8533155193bb', '2f64afb9-61a5-46ad-b972-e423bb6f8bcd', '47cc7a62-9845-4ab0-a513-2b1c545376d2'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:02 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:38:02 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Acquiring lock "cinder-2d9012be-aff6-4f08-9f06-1e91c8203026-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "cinder-2d9012be-aff6-4f08-9f06-1e91c8203026-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] Created reservations ['b0d4523b-5871-465a-8028-1ec63aaaceac'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Acquiring lock "cinder-quobyte-2d9012be-aff6-4f08-9f06-1e91c8203026" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "cinder-quobyte-2d9012be-aff6-4f08-9f06-1e91c8203026" acquired by "delete_volume" :: waited 0.040s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af5c57f-6772-49b5-9bb1-c184c94e088f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:03 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:38:03 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:03 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.187s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:03 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:38:03 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4ed4d30d-08bf-4522-aa47-33a557503a5d tempest-GroupsTest-1471472897 None] Delete group completed successfully. Jul 05 19:38:03 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026 Jul 05 19:38:03 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:04 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.366s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:04 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:38:04 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-73e2a249-8491-4d95-bcfc-8586ce419423 tempest-GroupsTest-1471472897 None] Delete group completed successfully. Jul 05 19:38:05 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026" returned: 0 in 1.733s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:05 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026 Jul 05 19:38:05 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:06 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-54cb4a58-f49a-4cd6-8bb3-d2df01dc25c2 tempest-GroupsTest-1471472897 None] Group tempest-GroupsTest-Group-1688944315: creating Jul 05 19:38:06 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-54cb4a58-f49a-4cd6-8bb3-d2df01dc25c2 tempest-GroupsTest-1471472897 None] Group tempest-GroupsTest-Group-1688944315: created successfully Jul 05 19:38:06 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-54cb4a58-f49a-4cd6-8bb3-d2df01dc25c2 tempest-GroupsTest-1471472897 None] Create group completed successfully. Jul 05 19:38:06 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2d9012be-aff6-4f08-9f06-1e91c8203026" returned: 0 in 1.188s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "cinder-quobyte-2d9012be-aff6-4f08-9f06-1e91c8203026" released by "delete_volume" :: held 3.039s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:06 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Created reservations ['e2798b33-b359-4b2d-a7bb-8d8801426e3c', '60113864-4aaf-4a04-a538-6035457d956d', '88d6eb3a-de27-4923-bea2-c0b97d40c011', 'c30b0f52-8c56-4fda-a3d5-f0de1bd5ef67'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:06 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:38:06 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:07 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.252s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:38:08 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Deleted volume successfully. Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7329ecdc-1aca-4a04-92cc-4d352228c10a tempest-AttachVolumeShelveTestJSON-1102601362 None] Lock "cinder-2d9012be-aff6-4f08-9f06-1e91c8203026-delete_volume" released by "delete_volume" :: held 4.800s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Flow 'volume_create_manager' (fab4f2c8-09d3-4b8e-baf0-f1275eafc2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de9c2ca-e861-413b-9840-4e337ab3a1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de9c2ca-e861-413b-9840-4e337ab3a1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648635784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c699228-379b-4545-b1a7-48d865910c54,host='devstack@QuobyteHD#QuobyteHD',id=a2d4fc0e-540d-4559-a344-8949e47a4aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2bfc963f584f0880917079566c76dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:38:08Z,use_quota=True,user_id='459e476161d94fa1bf1a5a3657d8a6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef7a841f-9045-4b04-a769-c811367e18d6),volume_type_id=ef7a841f-9045-4b04-a769-c811367e18d6)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8acd2b0-a946-4fc9-bd6d-07c23e9d0704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8acd2b0-a946-4fc9-bd6d-07c23e9d0704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0148a04c-e4d2-4de0-a064-fe867affb654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0148a04c-e4d2-4de0-a064-fe867affb654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d4fc0e-540d-4559-a344-8949e47a4aed', 'volume_name': 'volume-a2d4fc0e-540d-4559-a344-8949e47a4aed', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48331364-63c5-437f-a36d-f94e3fa0c130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48331364-63c5-437f-a36d-f94e3fa0c130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f06372-ba12-4e49-9ca7-b4bdd92294c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:08 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Volume a2d4fc0e-540d-4559-a344-8949e47a4aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d4fc0e-540d-4559-a344-8949e47a4aed', 'volume_size': 1} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c699228-379b-4545-b1a7-48d865910c54,created_at=2026-07-05T17:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648635784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c699228-379b-4545-b1a7-48d865910c54,host='devstack@QuobyteHD#QuobyteHD',id=a2d4fc0e-540d-4559-a344-8949e47a4aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2bfc963f584f0880917079566c76dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:38:08Z,use_quota=True,user_id='459e476161d94fa1bf1a5a3657d8a6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef7a841f-9045-4b04-a769-c811367e18d6),volume_type_id=ef7a841f-9045-4b04-a769-c811367e18d6)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Creating volume a2d4fc0e-540d-4559-a344-8949e47a4aed {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:38:08 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:38:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:08 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed 1073741824 Jul 05 19:38:08 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:10 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed 1073741824" returned: 0 in 2.023s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:10 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed Jul 05 19:38:10 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:11 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed" returned: 0 in 0.953s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] <== create_volume: return (3046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:38:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.052s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f06372-ba12-4e49-9ca7-b4bdd92294c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d4fc0e-540d-4559-a344-8949e47a4aed', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff6ebb-40d3-4746-be96-9a0096335c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:11 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Volume volume-a2d4fc0e-540d-4559-a344-8949e47a4aed (a2d4fc0e-540d-4559-a344-8949e47a4aed): created successfully Jul 05 19:38:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff6ebb-40d3-4746-be96-9a0096335c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Flow 'volume_create_manager' (fab4f2c8-09d3-4b8e-baf0-f1275eafc2d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:38:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f0670236-3425-467b-8f8c-8ac9070e8c57 tempest-GroupsTest-1471472897 None] Created volume successfully. Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Flow 'volume_create_manager' (102d7f50-fe2d-4950-900b-f615339067be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa1f84a-16ea-480a-9e09-6e3b3e107178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa1f84a-16ea-480a-9e09-6e3b3e107178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858641202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c699228-379b-4545-b1a7-48d865910c54,host='devstack@QuobyteHD#QuobyteHD',id=2cc50997-2af5-486a-bb1d-b0bb7c87cef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2bfc963f584f0880917079566c76dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:38:13Z,use_quota=True,user_id='459e476161d94fa1bf1a5a3657d8a6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef7a841f-9045-4b04-a769-c811367e18d6),volume_type_id=ef7a841f-9045-4b04-a769-c811367e18d6)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d53c8c-90bd-4a87-afc5-f7522bca02de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d53c8c-90bd-4a87-afc5-f7522bca02de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2133c7-9890-425d-aa22-d2608eea612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2133c7-9890-425d-aa22-d2608eea612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc50997-2af5-486a-bb1d-b0bb7c87cef2', 'volume_name': 'volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be80e82d-3c5e-4862-9549-b8a39a2efcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be80e82d-3c5e-4862-9549-b8a39a2efcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8b7027-5a0a-4954-92dc-0b04be86812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:13 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Volume 2cc50997-2af5-486a-bb1d-b0bb7c87cef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2', 'volume_size': 1} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c699228-379b-4545-b1a7-48d865910c54,created_at=2026-07-05T17:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858641202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c699228-379b-4545-b1a7-48d865910c54,host='devstack@QuobyteHD#QuobyteHD',id=2cc50997-2af5-486a-bb1d-b0bb7c87cef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2bfc963f584f0880917079566c76dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:38:13Z,use_quota=True,user_id='459e476161d94fa1bf1a5a3657d8a6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef7a841f-9045-4b04-a769-c811367e18d6),volume_type_id=ef7a841f-9045-4b04-a769-c811367e18d6)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Creating volume 2cc50997-2af5-486a-bb1d-b0bb7c87cef2 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:38:13 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:38:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:13 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 1073741824 Jul 05 19:38:13 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:14 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 1073741824" returned: 0 in 1.128s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:14 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 Jul 05 19:38:14 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:15 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2" returned: 0 in 1.019s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] <== create_volume: return (2204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:38:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8b7027-5a0a-4954-92dc-0b04be86812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d820ea-1303-4948-8aed-914d3d8c7659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:15 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Volume volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 (2cc50997-2af5-486a-bb1d-b0bb7c87cef2): created successfully Jul 05 19:38:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d820ea-1303-4948-8aed-914d3d8c7659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Flow 'volume_create_manager' (102d7f50-fe2d-4950-900b-f615339067be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:38:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9c5efcde-f279-4bb1-93f1-a43cea4b91cb tempest-GroupsTest-1471472897 None] Created volume successfully. Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:16 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:38:16 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Acquiring lock "cinder-148823bd-24df-48c4-ac77-ab239cbac389-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "cinder-148823bd-24df-48c4-ac77-ab239cbac389-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Acquiring lock "cinder-quobyte-148823bd-24df-48c4-ac77-ab239cbac389" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "cinder-quobyte-148823bd-24df-48c4-ac77-ab239cbac389" acquired by "delete_volume" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de98ae3-4a9f-4713-b46a-d29425d84d90]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:38:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:17 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389 Jul 05 19:38:17 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:17 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.267s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:38:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-992c9276-ad71-4072-a7c3-d4c1dd5b9016 tempest-GroupsTest-1471472897 None] Update group completed successfully. Jul 05 19:38:18 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389" returned: 0 in 1.572s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:18 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389 Jul 05 19:38:18 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:19 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e19f3e20-4c56-4f7d-922f-840c1aafe125 tempest-GroupsTest-1471472897 None] Update group completed successfully. Jul 05 19:38:19 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-148823bd-24df-48c4-ac77-ab239cbac389" returned: 0 in 1.221s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "cinder-quobyte-148823bd-24df-48c4-ac77-ab239cbac389" released by "delete_volume" :: held 2.881s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:19 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Created reservations ['199b623d-2b5a-46d3-a720-240e0abdc243', 'e0d43a85-3246-4d59-be17-cb7310d81dff', 'e4d1d4d0-5c30-4308-bf41-183e6434d195', '23a3516f-3ace-4a00-955e-d3f5e199925a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:19 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:38:19 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:21 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.362s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:21 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:38:21 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Deleted volume successfully. Jul 05 19:38:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f38731ca-7898-4cef-926a-4b121fa9ecc8 tempest-ServerRescueNegativeTestJSON-884971459 None] Lock "cinder-148823bd-24df-48c4-ac77-ab239cbac389-delete_volume" released by "delete_volume" :: held 4.655s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Acquiring lock "cinder-quobyte-2cc50997-2af5-486a-bb1d-b0bb7c87cef2" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Lock "cinder-quobyte-2cc50997-2af5-486a-bb1d-b0bb7c87cef2" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:21 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca01de61-527f-46f9-8248-dc96b32490c5]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:38:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:21 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 Jul 05 19:38:21 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:22 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2" returned: 0 in 1.072s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:22 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2 Jul 05 19:38:22 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:23 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2cc50997-2af5-486a-bb1d-b0bb7c87cef2" returned: 0 in 0.974s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Lock "cinder-quobyte-2cc50997-2af5-486a-bb1d-b0bb7c87cef2" released by "delete_volume" :: held 2.124s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Acquiring lock "cinder-quobyte-a2d4fc0e-540d-4559-a344-8949e47a4aed" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Lock "cinder-quobyte-a2d4fc0e-540d-4559-a344-8949e47a4aed" acquired by "delete_volume" :: waited 0.043s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:23 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e7598b-4cdb-4626-abb8-73af0634851f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:38:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2e5de921-5c3d-4326-8a9a-9f726b87a53d tempest-GroupSnapshotsV319Test-697218042 None] Group tempest-GroupSnapshotsV319Test-Group-1480976034: creating Jul 05 19:38:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2e5de921-5c3d-4326-8a9a-9f726b87a53d tempest-GroupSnapshotsV319Test-697218042 None] Group tempest-GroupSnapshotsV319Test-Group-1480976034: created successfully Jul 05 19:38:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2e5de921-5c3d-4326-8a9a-9f726b87a53d tempest-GroupSnapshotsV319Test-697218042 None] Create group completed successfully. Jul 05 19:38:23 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed Jul 05 19:38:23 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:24 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed" returned: 0 in 0.889s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:24 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed Jul 05 19:38:24 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:25 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a2d4fc0e-540d-4559-a344-8949e47a4aed" returned: 0 in 0.924s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Lock "cinder-quobyte-a2d4fc0e-540d-4559-a344-8949e47a4aed" released by "delete_volume" :: held 1.890s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Created reservations ['53d9ea97-f758-454c-833e-9da4ed9adde9'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Flow 'volume_create_manager' (526a6e47-150a-40c1-b302-1af99e450c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2250368-8196-43e9-ac83-6638bc561e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2250368-8196-43e9-ac83-6638bc561e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-692630671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3710214b-c5e2-42fb-b6e4-d2a062911f1d,host='devstack@QuobyteHD#QuobyteHD',id=5f5e1ed7-b91b-4f40-a701-49591d5e9296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2444b933bfc44b188fa752f00113387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:38:26Z,use_quota=True,user_id='94bfa2e9664a4726abd45fa3d5c27eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b9a6f93-74d8-453d-acc6-3b59a103cc03),volume_type_id=8b9a6f93-74d8-453d-acc6-3b59a103cc03)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7111d117-5c47-4221-9f56-bf308b0b5980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7111d117-5c47-4221-9f56-bf308b0b5980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df63bac8-20bb-4782-9cc7-780c7f986ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df63bac8-20bb-4782-9cc7-780c7f986ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5e1ed7-b91b-4f40-a701-49591d5e9296', 'volume_name': 'volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b21d368-f8f3-4f0e-b17c-8ea2a389abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b21d368-f8f3-4f0e-b17c-8ea2a389abc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9641d24-505a-40e3-b237-f4fc7b5f64b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:25 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Volume 5f5e1ed7-b91b-4f40-a701-49591d5e9296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296', 'volume_size': 1} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3710214b-c5e2-42fb-b6e4-d2a062911f1d,created_at=2026-07-05T17:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-692630671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3710214b-c5e2-42fb-b6e4-d2a062911f1d,host='devstack@QuobyteHD#QuobyteHD',id=5f5e1ed7-b91b-4f40-a701-49591d5e9296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2444b933bfc44b188fa752f00113387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:38:26Z,use_quota=True,user_id='94bfa2e9664a4726abd45fa3d5c27eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b9a6f93-74d8-453d-acc6-3b59a103cc03),volume_type_id=8b9a6f93-74d8-453d-acc6-3b59a103cc03)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Creating volume 5f5e1ed7-b91b-4f40-a701-49591d5e9296 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:38:25 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:25 devstack cinder-volume[86389]: WARNING cinder.quota [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1141627000 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1141627000, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:38:25 devstack cinder-volume[86389]: WARNING cinder.quota [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1141627000 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1141627000, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:38:25 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 1073741824 Jul 05 19:38:25 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:25 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Created reservations ['c9760de8-359a-41ae-a3a7-c0d8ac00c52e', '1be1c144-94ca-4a48-bc13-fdcb6b2d7c36', 'b96a115f-4e18-41e4-bb52-f612b6f166cf', '65ebca09-e099-4b53-bb62-e58fd2ca5b11'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:26 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Created reservations ['2f743a82-316e-4c99-ae0a-445a0ad502e1', '9135abc2-e100-4b2b-835b-6d7b10a77170', '73904af6-acd9-4099-a929-dcac5d723596', '380584d0-67ea-4c97-a303-c6e2aaa4dc54'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:26 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:38:26 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:27 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 1073741824" returned: 0 in 1.424s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:27 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 Jul 05 19:38:27 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:27 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.233s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:27 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:38:27 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d2a46514-af0b-478c-b078-e2a7d88a00f2 tempest-GroupsTest-1471472897 None] Delete group completed successfully. Jul 05 19:38:28 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296" returned: 0 in 1.026s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] <== create_volume: return (2534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:38:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9641d24-505a-40e3-b237-f4fc7b5f64b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5c5edd-e04d-45b3-8577-13b8bbbe1c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:28 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Volume volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 (5f5e1ed7-b91b-4f40-a701-49591d5e9296): created successfully Jul 05 19:38:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5c5edd-e04d-45b3-8577-13b8bbbe1c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Flow 'volume_create_manager' (526a6e47-150a-40c1-b302-1af99e450c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:38:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-94bca6c7-ab87-4212-a0cb-2668580088a4 tempest-GroupSnapshotsV319Test-697218042 None] Created volume successfully. Jul 05 19:38:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] GroupSnapshot e5d3fdd9-1041-42e3-8e85-9a27ada10c03: creating. Jul 05 19:38:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Group snapshot e5d3fdd9-1041-42e3-8e85-9a27ada10c03: creating. {{(pid=86389) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 19:38:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Creating offline snapshot 98f9d6b4-8172-4314-aae6-e454a324749e of volume 5f5e1ed7-b91b-4f40-a701-49591d5e9296 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:38:29 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[904b727a-469e-4d58-aa60-2b395bfba46b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:38:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:30 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 Jul 05 19:38:30 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:30 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296" returned: 0 in 1.073s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:30 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e 1G Jul 05 19:38:30 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:32 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e 1G" returned: 0 in 1.109s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:32 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e Jul 05 19:38:32 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:32 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e" returned: 0 in 0.864s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:32 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:38:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:32 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e Jul 05 19:38:32 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:33 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e" returned: 0 in 0.692s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:33 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.info Jul 05 19:38:33 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:34 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.info" returned: 0 in 0.719s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:34 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:34 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.info Jul 05 19:38:34 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Flow 'volume_create_manager' (6df9ecd8-a0ff-44dc-b16a-cdece012dbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b73a866-1064-40f2-8b04-c0aae9d3cab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b73a866-1064-40f2-8b04-c0aae9d3cab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2022940245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a171cd2f-b493-4ce9-8649-84648e2bc360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5724716f01d54a11a5a3e36b8b07e6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:38:34Z,use_quota=True,user_id='4e22dacdc5054d8d9827f5da081a8de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ea4429-184b-4634-ac68-267d66ab89b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ea4429-184b-4634-ac68-267d66ab89b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59309c2e-5770-4882-ace0-05c820a12e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59309c2e-5770-4882-ace0-05c820a12e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a171cd2f-b493-4ce9-8649-84648e2bc360', 'volume_name': 'volume-a171cd2f-b493-4ce9-8649-84648e2bc360', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25662f3a-becb-4d5e-826b-c5f2986fff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25662f3a-becb-4d5e-826b-c5f2986fff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8828937e-b5d8-4f0d-b23f-92ddff534df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:34 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Volume a171cd2f-b493-4ce9-8649-84648e2bc360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a171cd2f-b493-4ce9-8649-84648e2bc360', 'volume_size': 1} Jul 05 19:38:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:35 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.info" returned: 0 in 0.695s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.309s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2022940245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a171cd2f-b493-4ce9-8649-84648e2bc360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5724716f01d54a11a5a3e36b8b07e6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:38:34Z,use_quota=True,user_id='4e22dacdc5054d8d9827f5da081a8de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Creating volume a171cd2f-b493-4ce9-8649-84648e2bc360 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:38:35 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:35 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 1073741824 Jul 05 19:38:35 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-da8e6eeb-ab93-4e38-a5bf-9ddc1237b249 tempest-GroupSnapshotsV319Test-697218042 None] group_snapshot e5d3fdd9-1041-42e3-8e85-9a27ada10c03: created successfully Jul 05 19:38:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] group_snapshot e5d3fdd9-1041-42e3-8e85-9a27ada10c03: deleting Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] group_snapshot e5d3fdd9-1041-42e3-8e85-9a27ada10c03: deleting {{(pid=86389) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Acquiring lock "cinder-quobyte-5f5e1ed7-b91b-4f40-a701-49591d5e9296" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Lock "cinder-quobyte-5f5e1ed7-b91b-4f40-a701-49591d5e9296" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Acquiring lock "cinder-quobyte-98f9d6b4-8172-4314-aae6-e454a324749e" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Lock "cinder-quobyte-98f9d6b4-8172-4314-aae6-e454a324749e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Deleting offline snapshot 98f9d6b4-8172-4314-aae6-e454a324749e of volume 5f5e1ed7-b91b-4f40-a701-49591d5e9296 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] snapshot_file for this snap is: volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea874528-cd68-4441-8b4c-c2973390f494]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:38:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:36 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e Jul 05 19:38:36 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:36 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 1073741824" returned: 0 in 1.059s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:36 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 Jul 05 19:38:36 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360" returned: 0 in 0.860s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:38:37 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8828937e-b5d8-4f0d-b23f-92ddff534df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a171cd2f-b493-4ce9-8649-84648e2bc360', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48331d6-2982-4fd7-9c35-4efa350222ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:38:37 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Volume volume-a171cd2f-b493-4ce9-8649-84648e2bc360 (a171cd2f-b493-4ce9-8649-84648e2bc360): created successfully Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48331d6-2982-4fd7-9c35-4efa350222ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Flow 'volume_create_manager' (6df9ecd8-a0ff-44dc-b16a-cdece012dbf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:38:37 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-dd6873be-85f1-4d4c-bfea-49ebdef34349 tempest-TaggedAttachmentsTest-658605207 None] Created volume successfully. Jul 05 19:38:37 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e" returned: 0 in 1.248s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b02a425-7116-46ed-a523-500b40cd5843]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:38:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:37 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 Jul 05 19:38:37 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:38 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296" returned: 0 in 1.058s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:38 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e Jul 05 19:38:38 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:39 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e" returned: 0 in 1.124s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:39 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e Jul 05 19:38:39 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:40 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296.98f9d6b4-8172-4314-aae6-e454a324749e" returned: 0 in 0.917s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Lock "cinder-quobyte-98f9d6b4-8172-4314-aae6-e454a324749e" released by "_delete_snapshot" :: held 4.500s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Lock "cinder-quobyte-5f5e1ed7-b91b-4f40-a701-49591d5e9296" released by "delete_snapshot" :: held 4.531s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:40 devstack cinder-volume[86389]: WARNING cinder.quota [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1956763975 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1956763975, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:38:40 devstack cinder-volume[86389]: WARNING cinder.quota [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1956763975 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1956763975, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:38:40 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] Created reservations ['902db945-7466-4053-9f85-87991bda6d99', '9abb2d58-4567-4968-99b7-5d654dcf48fe', '8b619ee9-b311-452b-9210-384c3de9f57c', '3a4a8972-6d47-44d4-af99-292f405e3c0f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:40 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9c7ea780-d33a-440c-a30b-6a0ef296b379 tempest-GroupSnapshotsV319Test-697218042 None] group_snapshot e5d3fdd9-1041-42e3-8e85-9a27ada10c03: deleted successfully Jul 05 19:38:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Acquiring lock "cinder-quobyte-5f5e1ed7-b91b-4f40-a701-49591d5e9296" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:38:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Lock "cinder-quobyte-5f5e1ed7-b91b-4f40-a701-49591d5e9296" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:38:41 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6f88e4-77d9-4e00-b25b-53f0ca760889]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:38:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:41 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 Jul 05 19:38:41 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:42 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296" returned: 0 in 0.974s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:42 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296 Jul 05 19:38:42 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:43 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5f5e1ed7-b91b-4f40-a701-49591d5e9296" returned: 0 in 0.794s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Lock "cinder-quobyte-5f5e1ed7-b91b-4f40-a701-49591d5e9296" released by "delete_volume" :: held 1.869s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Created reservations ['660fc350-e185-424d-ae39-3a1fa0910673'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:43 devstack cinder-volume[86389]: WARNING cinder.quota [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1956763975 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1956763975, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Created reservations ['cf6d60b9-e9c1-459f-b3e4-a036ea77d13b', 'e74e09e2-fa8a-4aa1-b42c-4e8c221f0ad0', '502d959f-3039-441d-883e-59ec8a0dbf8f', '405b11b8-2aee-4b0d-a537-9e825fe805b6'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:38:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:38:43 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:38:43 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:38:44 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Jul 05 19:38:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.897s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:38:44 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:38:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fd844229-36de-41be-a9ae-e0fa1bdd507b tempest-GroupSnapshotsV319Test-697218042 None] Delete group completed successfully. Jul 05 19:38:53 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=76,cinder:UPDATE=91,cinder:INSERT=21,cinder:DELETE=2 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:38:53 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=84,cinder:SELECT=77,cinder:DELETE=5,cinder:INSERT=17 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:39:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-49e5a12b-ee8d-4b6e-bf38-83e5968a2b15 tempest-GroupsV320Test-827316519 None] Group tempest-GroupsV320Test-Group-1436531084: creating Jul 05 19:39:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-49e5a12b-ee8d-4b6e-bf38-83e5968a2b15 tempest-GroupsV320Test-827316519 None] Group tempest-GroupsV320Test-Group-1436531084: created successfully Jul 05 19:39:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-49e5a12b-ee8d-4b6e-bf38-83e5968a2b15 tempest-GroupsV320Test-827316519 None] Create group completed successfully. Jul 05 19:39:03 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] Created reservations ['ce83d5bb-719a-463c-a607-57a59a90b93a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:39:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:39:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:39:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:03 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:39:03 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:05 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.400s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:05 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:39:05 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-276878b0-04c4-45f2-aeb0-b3e29ebda7a8 tempest-GroupsV320Test-827316519 None] Delete group completed successfully. Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Flow 'volume_create_manager' (1f0ca3b5-43ad-4811-ad92-334dc4bf4627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dee9b9d-a856-4c28-b5fe-e1a4d1db2bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dee9b9d-a856-4c28-b5fe-e1a4d1db2bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-73637984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ce6365-17f2-45c5-b27b-5bb60f25bd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3722846b7824458baaf59251b1ba3d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:39:13Z,use_quota=True,user_id='5b24c1fcf0cd43daa63b1daed5e69d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dca162-b04f-40e3-9dad-ae235afe0e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dca162-b04f-40e3-9dad-ae235afe0e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d93594b-a465-44c6-aba1-42e0495486d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d93594b-a465-44c6-aba1-42e0495486d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ce6365-17f2-45c5-b27b-5bb60f25bd10', 'volume_name': 'volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71003566-1463-41c9-9948-318fffa23cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71003566-1463-41c9-9948-318fffa23cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc94aee-9077-4f91-823f-d2e5bceae5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:12 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10', 'volume_size': 1} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-73637984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ce6365-17f2-45c5-b27b-5bb60f25bd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3722846b7824458baaf59251b1ba3d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:39:13Z,use_quota=True,user_id='5b24c1fcf0cd43daa63b1daed5e69d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Creating volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:39:12 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:39:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:12 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 1073741824 Jul 05 19:39:12 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:13 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 1073741824" returned: 0 in 1.028s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:13 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 Jul 05 19:39:13 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:14 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10" returned: 0 in 0.804s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:39:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc94aee-9077-4f91-823f-d2e5bceae5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f794cc7-25af-4d38-9d59-be92c82d6566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:14 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Volume volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 (11ce6365-17f2-45c5-b27b-5bb60f25bd10): created successfully Jul 05 19:39:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f794cc7-25af-4d38-9d59-be92c82d6566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Flow 'volume_create_manager' (1f0ca3b5-43ad-4811-ad92-334dc4bf4627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:39:14 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4d55a0db-9b57-494f-8dc5-84c363abffa9 tempest-SnapshotsActionsTest-159033091 None] Created volume successfully. Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Creating offline snapshot dcc12d13-f086-41a7-8f56-6ab7290f741d of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84da599-2a52-47ef-98e3-e8bd97d0d683]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:16 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:39:16 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:16 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 Jul 05 19:39:16 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:16 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.711s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 8 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:39:16 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10" returned: 0 in 0.815s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:16 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d 1G Jul 05 19:39:16 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:18 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d 1G" returned: 0 in 1.237s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:18 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:39:18 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:19 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 1.209s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:19 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d is being set with open permissions: ugo+rw Jul 05 19:39:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:19 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:39:19 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:20 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 1.133s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:20 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.info Jul 05 19:39:20 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:21 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.info" returned: 0 in 0.764s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:21 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.info is being set with open permissions: ugo+rw Jul 05 19:39:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:21 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.info Jul 05 19:39:21 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:22 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.info" returned: 0 in 0.729s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.025s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:22 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-71f33c11-6411-4d70-a89b-d42c7e2f1598 tempest-SnapshotsActionsTest-159033091 None] Create snapshot completed successfully Jul 05 19:39:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Creating offline snapshot 7feab7b0-a826-4f5f-abfd-954dca6e8eae of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:39:23 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[19054360-7f72-409b-83f4-d188c2136de1]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:23 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:39:23 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:24 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 0.964s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:24 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae 1G Jul 05 19:39:24 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:25 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae 1G" returned: 0 in 1.052s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:25 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae Jul 05 19:39:25 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:26 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae" returned: 0 in 0.920s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:26 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae is being set with open permissions: ugo+rw Jul 05 19:39:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:26 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae Jul 05 19:39:26 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:27 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae" returned: 0 in 1.202s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.303s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:27 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c9b6f330-0333-47b3-91f7-475e429516d5 tempest-SnapshotsActionsTest-159033091 None] Create snapshot completed successfully Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-7feab7b0-a826-4f5f-abfd-954dca6e8eae-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-7feab7b0-a826-4f5f-abfd-954dca6e8eae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-quobyte-7feab7b0-a826-4f5f-abfd-954dca6e8eae" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-7feab7b0-a826-4f5f-abfd-954dca6e8eae" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Deleting offline snapshot 7feab7b0-a826-4f5f-abfd-954dca6e8eae of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] snapshot_file for this snap is: volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dcbe05-37ed-493b-a5b0-de8ac59e1115]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:29 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae Jul 05 19:39:29 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:30 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae" returned: 0 in 1.174s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:30 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[34732986-2fdb-492a-9a3f-5eeb506ca3ef]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:30 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:39:30 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:31 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 0.885s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:31 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae Jul 05 19:39:31 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:32 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae" returned: 0 in 1.153s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:32 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae Jul 05 19:39:32 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:33 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.7feab7b0-a826-4f5f-abfd-954dca6e8eae" returned: 0 in 0.852s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-7feab7b0-a826-4f5f-abfd-954dca6e8eae" released by "_delete_snapshot" :: held 4.221s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" released by "delete_snapshot" :: held 4.266s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:33 devstack cinder-volume[86389]: WARNING cinder.quota [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:39:33 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Created reservations ['10efd0be-712e-48b9-8f09-e5a4b23ac75d', 'be2d1e11-4f1d-4a97-b5f2-ce7ce6d1ea63', '50ab891c-41f9-4f89-aaa1-2d857ead2f72', '42a07d0f-4a2a-4e7f-aa91-c18e5dda379f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:39:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Delete snapshot completed successfully. Jul 05 19:39:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d4f74a79-caae-495b-9fbc-89b1ae4758d3 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-7feab7b0-a826-4f5f-abfd-954dca6e8eae-delete_snapshot" released by "delete_snapshot" :: held 4.587s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Creating offline snapshot 05b5df0c-31e6-4389-afa4-28669b806a59 of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:39:34 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b613a799-56b6-4cf9-98a2-e52eadabf794]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:35 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:39:35 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:36 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 1.058s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:36 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 1G Jul 05 19:39:36 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:36 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 1G" returned: 0 in 0.871s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:36 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 Jul 05 19:39:36 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:37 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59" returned: 0 in 0.709s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:37 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 is being set with open permissions: ugo+rw Jul 05 19:39:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:37 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 Jul 05 19:39:37 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:38 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59" returned: 0 in 0.673s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.427s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:38 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-658b6d03-7325-43c1-be5b-6f2953cb36ad tempest-SnapshotsActionsTest-159033091 None] Create snapshot completed successfully Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-05b5df0c-31e6-4389-afa4-28669b806a59-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-05b5df0c-31e6-4389-afa4-28669b806a59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-quobyte-05b5df0c-31e6-4389-afa4-28669b806a59" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-05b5df0c-31e6-4389-afa4-28669b806a59" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Deleting offline snapshot 05b5df0c-31e6-4389-afa4-28669b806a59 of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] snapshot_file for this snap is: volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f1d266-ea0e-44f4-aa38-7b90201fa0d8]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:39 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 Jul 05 19:39:39 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-43716ba0-fd72-41e9-b3ac-deffb24bc9c1 req-1049f4f3-6ba2-4ead-a798-37874cea5934 tempest-TaggedAttachmentsTest-658605207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-43716ba0-fd72-41e9-b3ac-deffb24bc9c1 req-1049f4f3-6ba2-4ead-a798-37874cea5934 tempest-TaggedAttachmentsTest-658605207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68046f9-183b-4dd3-be7e-8f11ba240fcc]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-43716ba0-fd72-41e9-b3ac-deffb24bc9c1 req-1049f4f3-6ba2-4ead-a798-37874cea5934 tempest-TaggedAttachmentsTest-658605207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:40 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59" returned: 0 in 1.005s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b6a449-5509-4350-b966-6f48c87d1fc6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:40 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 Jul 05 19:39:40 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:40 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:39:40 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (be429ce1-4134-4572-a6f6-565228ccffc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcc7dc4-c909-474e-b3ce-0f42a6f29dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcc7dc4-c909-474e-b3ce-0f42a6f29dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845755578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a352c0f0-ae66-4788-aeb8-096dbefb3f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:39:41Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd91d0e6-5ebb-4bb3-94d5-d0675aa6cc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd91d0e6-5ebb-4bb3-94d5-d0675aa6cc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482f14af-753e-4474-897b-bf1866f877f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482f14af-753e-4474-897b-bf1866f877f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a352c0f0-ae66-4788-aeb8-096dbefb3f00', 'volume_name': 'volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f885732-a37f-45e0-8dd1-70c5e19cfd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:41 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f885732-a37f-45e0-8dd1-70c5e19cfd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecd9f7a-982a-4de2-beda-f443233611ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:41 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Volume a352c0f0-ae66-4788-aeb8-096dbefb3f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00', 'volume_size': 1} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-43716ba0-fd72-41e9-b3ac-deffb24bc9c1 req-1049f4f3-6ba2-4ead-a798-37874cea5934 tempest-TaggedAttachmentsTest-658605207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360" returned: 0 in 1.266s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-43716ba0-fd72-41e9-b3ac-deffb24bc9c1 req-1049f4f3-6ba2-4ead-a798-37874cea5934 tempest-TaggedAttachmentsTest-658605207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.296s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845755578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a352c0f0-ae66-4788-aeb8-096dbefb3f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:39:41Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Creating volume a352c0f0-ae66-4788-aeb8-096dbefb3f00 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:39:41 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:41 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 1073741824 Jul 05 19:39:41 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-43716ba0-fd72-41e9-b3ac-deffb24bc9c1 req-1049f4f3-6ba2-4ead-a798-37874cea5934 tempest-TaggedAttachmentsTest-658605207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-a171cd2f-b493-4ce9-8649-84648e2bc360', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60bd44f5-7bbd-41ab-953a-9ce3b3b51d45', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:39:41 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-43716ba0-fd72-41e9-b3ac-deffb24bc9c1 req-1049f4f3-6ba2-4ead-a798-37874cea5934 tempest-TaggedAttachmentsTest-658605207 None] attachment_update completed successfully. Jul 05 19:39:41 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 1.461s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:41 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 Jul 05 19:39:41 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:42 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 1073741824" returned: 0 in 1.200s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:42 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 Jul 05 19:39:42 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:43 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59" returned: 0 in 1.093s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:43 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59 Jul 05 19:39:43 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:43 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00" returned: 0 in 0.689s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecd9f7a-982a-4de2-beda-f443233611ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf71285f-ff39-4f05-82d0-11060e4baacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:43 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Volume volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 (a352c0f0-ae66-4788-aeb8-096dbefb3f00): created successfully Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf71285f-ff39-4f05-82d0-11060e4baacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (be429ce1-4134-4572-a6f6-565228ccffc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:39:43 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ac27683f-b26c-4cf7-a5af-095e3e8d3c41 tempest-VolumesActionsTest-2080387135 None] Created volume successfully. Jul 05 19:39:43 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.05b5df0c-31e6-4389-afa4-28669b806a59" returned: 0 in 0.681s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-05b5df0c-31e6-4389-afa4-28669b806a59" released by "_delete_snapshot" :: held 4.398s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" released by "delete_snapshot" :: held 4.429s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Created reservations ['01e40021-6a02-42c4-84df-98fffd9deb4a', '6dd7fee8-40dd-4c79-bb1c-b0d7eed18d81', '3fd21f0e-fd8e-4fef-84c2-e6cae841b6cb', '2e81988e-b0c8-4c77-88c4-e3487d5e2690'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:39:43 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Delete snapshot completed successfully. Jul 05 19:39:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0a56b9de-7b94-4bbf-bdab-733e4b445ee2 tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-05b5df0c-31e6-4389-afa4-28669b806a59-delete_snapshot" released by "delete_snapshot" :: held 4.569s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-01676211-101a-4a2b-9a16-a12d69669bfe tempest-VolumesActionsTest-2080387135 None] Acquiring lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00" by "attach_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-01676211-101a-4a2b-9a16-a12d69669bfe tempest-VolumesActionsTest-2080387135 None] Lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00" acquired by "attach_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-01676211-101a-4a2b-9a16-a12d69669bfe tempest-VolumesActionsTest-2080387135 None] Attaching volume a352c0f0-ae66-4788-aeb8-096dbefb3f00 to instance 126ae52b-2564-4587-b02b-85c5d5643375 at mountpoint /dev/vdb on host None. Jul 05 19:39:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-01676211-101a-4a2b-9a16-a12d69669bfe tempest-VolumesActionsTest-2080387135 None] Attach volume completed successfully. Jul 05 19:39:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-01676211-101a-4a2b-9a16-a12d69669bfe tempest-VolumesActionsTest-2080387135 None] Lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00" released by "attach_volume" :: held 0.139s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Creating offline snapshot 57acabe1-c366-446c-98fa-117642135582 of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:39:45 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b5810c-dd8c-4505-86ff-95d1898d7d60]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:45 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:39:45 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:45 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-83e0df53-b391-447a-8e39-879a895c2176 tempest-VolumesActionsTest-1318173805 None] Terminate volume connection completed successfully. Jul 05 19:39:45 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 0.876s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:45 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 1G Jul 05 19:39:45 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-83e0df53-b391-447a-8e39-879a895c2176 tempest-VolumesActionsTest-1318173805 None] Acquiring lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00-detach_volume" by "detach_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-83e0df53-b391-447a-8e39-879a895c2176 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-83e0df53-b391-447a-8e39-879a895c2176 tempest-VolumesActionsTest-1318173805 None] Detaching volume a352c0f0-ae66-4788-aeb8-096dbefb3f00 from instance 126ae52b-2564-4587-b02b-85c5d5643375. Jul 05 19:39:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-83e0df53-b391-447a-8e39-879a895c2176 tempest-VolumesActionsTest-1318173805 None] Detach volume completed successfully. Jul 05 19:39:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-83e0df53-b391-447a-8e39-879a895c2176 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1c846a96-c0da-4d43-b6d8-7dc2ef26604f tempest-VolumesActionsTest-2080387135 None] Acquiring lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00-detach_volume" by "detach_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1c846a96-c0da-4d43-b6d8-7dc2ef26604f tempest-VolumesActionsTest-2080387135 None] Lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1c846a96-c0da-4d43-b6d8-7dc2ef26604f tempest-VolumesActionsTest-2080387135 None] Volume detach called, but volume not attached. Jul 05 19:39:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1c846a96-c0da-4d43-b6d8-7dc2ef26604f tempest-VolumesActionsTest-2080387135 None] Lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:46 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 1G" returned: 0 in 1.005s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:46 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 Jul 05 19:39:46 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Acquiring lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Acquiring lock "cinder-quobyte-a352c0f0-ae66-4788-aeb8-096dbefb3f00" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Lock "cinder-quobyte-a352c0f0-ae66-4788-aeb8-096dbefb3f00" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:47 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582" returned: 0 in 0.898s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:47 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 is being set with open permissions: ugo+rw Jul 05 19:39:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:47 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe76dca-13cc-4c1f-88b0-ee9b57626dca]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:47 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 Jul 05 19:39:47 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:48 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 Jul 05 19:39:48 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-b25af503-b18e-4d47-aac5-df738f141b98 req-46b57036-f4fe-465d-b9a8-e18df61ec61c tempest-TaggedAttachmentsTest-658605207 None] Terminate volume connection completed successfully. Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-b25af503-b18e-4d47-aac5-df738f141b98 req-46b57036-f4fe-465d-b9a8-e18df61ec61c tempest-TaggedAttachmentsTest-658605207 None] Deleting attachment 60bd44f5-7bbd-41ab-953a-9ce3b3b51d45. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Flow 'volume_create_manager' (e255e946-7f5e-4033-8040-a15a8f1fce02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e0fa7a-bcde-4f00-9e9c-fe6916c14de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e0fa7a-bcde-4f00-9e9c-fe6916c14de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1188811082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989ed373-d23e-4bdc-b316-9f6f5bf69d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffda385a0e9f4eb5a8d80a3584aaa90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:39:48Z,use_quota=True,user_id='2be56327e486410f91d42d01ff094699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23c2095-be3d-4a5b-abca-cb9d32dfdbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23c2095-be3d-4a5b-abca-cb9d32dfdbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fc8c0f-0e37-41e1-afeb-ba4f46d3e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fc8c0f-0e37-41e1-afeb-ba4f46d3e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989ed373-d23e-4bdc-b316-9f6f5bf69d2b', 'volume_name': 'volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dae9024-e2bc-4173-892b-23c102e1f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dae9024-e2bc-4173-892b-23c102e1f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692d8f7f-bbbd-4330-bf16-af4ecf48aa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:48 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Volume 989ed373-d23e-4bdc-b316-9f6f5bf69d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b', 'volume_size': 1} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:48 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582" returned: 0 in 0.962s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.870s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1188811082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989ed373-d23e-4bdc-b316-9f6f5bf69d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffda385a0e9f4eb5a8d80a3584aaa90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:39:48Z,use_quota=True,user_id='2be56327e486410f91d42d01ff094699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Creating volume 989ed373-d23e-4bdc-b316-9f6f5bf69d2b {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:39:48 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:39:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:48 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b 1073741824 Jul 05 19:39:48 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b8115587-836c-4478-9eb2-71a31b527404 tempest-SnapshotsActionsTest-159033091 None] Create snapshot completed successfully Jul 05 19:39:49 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00" returned: 0 in 1.297s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:49 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00 Jul 05 19:39:49 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-57acabe1-c366-446c-98fa-117642135582-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-57acabe1-c366-446c-98fa-117642135582-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-quobyte-57acabe1-c366-446c-98fa-117642135582" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-57acabe1-c366-446c-98fa-117642135582" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Deleting offline snapshot 57acabe1-c366-446c-98fa-117642135582 of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] snapshot_file for this snap is: volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd06d27-9a80-4501-a9db-621dc886a930]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:49 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 Jul 05 19:39:49 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:50 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b 1073741824" returned: 0 in 1.257s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:50 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b Jul 05 19:39:50 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:50 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a352c0f0-ae66-4788-aeb8-096dbefb3f00" returned: 0 in 1.173s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Lock "cinder-quobyte-a352c0f0-ae66-4788-aeb8-096dbefb3f00" released by "delete_volume" :: held 2.567s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Created reservations ['84130be4-bde4-44e8-87ac-8eedf52d8b65', '75166456-75dd-46c1-b288-403368e3c0da', 'f6fb63c8-6811-4a2b-b2f2-b0caee50b038', 'b259918b-3ad8-4524-940a-45ea5f9feff4'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:50 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:39:50 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:50 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582" returned: 0 in 1.267s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3c79e8-0350-407b-94b6-11721a71bd1f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:51 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:39:51 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:51 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b" returned: 0 in 1.197s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] <== create_volume: return (2522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.534s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692d8f7f-bbbd-4330-bf16-af4ecf48aa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeae6120-6807-48f5-8d47-ece3a5df5d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:51 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Volume volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b (989ed373-d23e-4bdc-b316-9f6f5bf69d2b): created successfully Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeae6120-6807-48f5-8d47-ece3a5df5d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Flow 'volume_create_manager' (e255e946-7f5e-4033-8040-a15a8f1fce02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:39:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2f4d2b2c-dfbd-4fd1-a7f3-22c6276e9ef7 tempest-AttachVolumeTestJSON-368282853 None] Created volume successfully. Jul 05 19:39:51 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.159s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:39:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Deleted volume successfully. Jul 05 19:39:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4e3a9dad-6798-4101-af6d-66975e5effce tempest-VolumesActionsTest-2080387135 None] Lock "cinder-a352c0f0-ae66-4788-aeb8-096dbefb3f00-delete_volume" released by "delete_volume" :: held 4.107s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:52 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 1.424s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:52 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 Jul 05 19:39:52 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:53 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582" returned: 0 in 0.805s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:53 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582 Jul 05 19:39:53 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:53 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.57acabe1-c366-446c-98fa-117642135582" returned: 0 in 0.800s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-57acabe1-c366-446c-98fa-117642135582" released by "_delete_snapshot" :: held 4.521s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" released by "delete_snapshot" :: held 4.553s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:54 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=51,cinder:UPDATE=45,cinder:DELETE=2,cinder:INSERT=9 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:39:54 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=55,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=6 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:39:54 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Created reservations ['dd9c6c59-ae74-479f-87b5-fccf09a2c9fb', 'cd3d53bf-7455-4928-b124-6548b8e5ec4d', '3dca74b9-ac30-4351-841e-eecf32ac377a', '6e525571-17b3-4360-9ba1-ac35b497fd76'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:39:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Delete snapshot completed successfully. Jul 05 19:39:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3c6cf147-0392-45db-92f2-1d48e23b80dc tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-57acabe1-c366-446c-98fa-117642135582-delete_snapshot" released by "delete_snapshot" :: held 4.785s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:39:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Creating offline snapshot dd5a7cde-c707-4839-9989-fd9c68021980 of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:39:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[48942f2a-ea57-46fb-a0a6-ad67397ecd8d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:55 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:39:55 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-6435998a-112c-4763-a04b-75948d61df0a req-e07805b4-4a68-442c-8828-8c71720eebcf tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:55 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 0.778s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:39:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:55 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 1G Jul 05 19:39:55 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:56 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 1G" returned: 0 in 0.924s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:56 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 Jul 05 19:39:56 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:57 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980" returned: 0 in 0.700s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:57 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 is being set with open permissions: ugo+rw Jul 05 19:39:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:57 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 Jul 05 19:39:57 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:58 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980" returned: 0 in 0.647s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-6435998a-112c-4763-a04b-75948d61df0a req-e07805b4-4a68-442c-8828-8c71720eebcf tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.986s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:58 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a76c874-ff15-43eb-837f-f73fdf35822b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-6435998a-112c-4763-a04b-75948d61df0a req-e07805b4-4a68-442c-8828-8c71720eebcf tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3c870b9e-048d-4ad2-a92c-93cdbe81403a tempest-SnapshotsActionsTest-159033091 None] Create snapshot completed successfully Jul 05 19:39:58 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b Jul 05 19:39:58 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (9b5b87b3-cc11-4bce-b049-3c97460d92c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400320e7-292b-4119-b62e-a290ed298274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400320e7-292b-4119-b62e-a290ed298274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1269951222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864041c9-3cae-4a28-8034-f87c71de61e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:39:59Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535ce722-4887-4b6b-9826-2522f66f51f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535ce722-4887-4b6b-9826-2522f66f51f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1b1aab-d730-4520-b428-cdf04efab01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1b1aab-d730-4520-b428-cdf04efab01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864041c9-3cae-4a28-8034-f87c71de61e1', 'volume_name': 'volume-864041c9-3cae-4a28-8034-f87c71de61e1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cace9e7-678d-4371-bb14-135c262323ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cace9e7-678d-4371-bb14-135c262323ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299c85ee-ccc4-4ec7-8ea3-cc54e2c7679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:39:59 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Volume 864041c9-3cae-4a28-8034-f87c71de61e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864041c9-3cae-4a28-8034-f87c71de61e1', 'volume_size': 1} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:59 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-6435998a-112c-4763-a04b-75948d61df0a req-e07805b4-4a68-442c-8828-8c71720eebcf tempest-AttachVolumeTestJSON-368282853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b" returned: 0 in 1.159s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-6435998a-112c-4763-a04b-75948d61df0a req-e07805b4-4a68-442c-8828-8c71720eebcf tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.198s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.215s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1269951222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864041c9-3cae-4a28-8034-f87c71de61e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:39:59Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Creating volume 864041c9-3cae-4a28-8034-f87c71de61e1 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:39:59 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:59 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1 1073741824 Jul 05 19:39:59 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-6435998a-112c-4763-a04b-75948d61df0a req-e07805b4-4a68-442c-8828-8c71720eebcf tempest-AttachVolumeTestJSON-368282853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd01708f4-da94-43fa-9b00-ba772404d563', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-dd5a7cde-c707-4839-9989-fd9c68021980-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-dd5a7cde-c707-4839-9989-fd9c68021980-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:59 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-6435998a-112c-4763-a04b-75948d61df0a req-e07805b4-4a68-442c-8828-8c71720eebcf tempest-AttachVolumeTestJSON-368282853 None] attachment_update completed successfully. Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Acquiring lock "cinder-quobyte-dd5a7cde-c707-4839-9989-fd9c68021980" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-dd5a7cde-c707-4839-9989-fd9c68021980" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Deleting offline snapshot dd5a7cde-c707-4839-9989-fd9c68021980 of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] snapshot_file for this snap is: volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e116b0-0caa-4101-97f6-7ce45ba2a2a5]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:39:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:39:59 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 Jul 05 19:39:59 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:00 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1 1073741824" returned: 0 in 1.254s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:00 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980" returned: 0 in 1.074s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:40:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:00 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8522e2a8-e456-4569-a485-88c2df3db244]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:00 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1 Jul 05 19:40:00 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:00 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:40:00 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:01 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1" returned: 0 in 0.752s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299c85ee-ccc4-4ec7-8ea3-cc54e2c7679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864041c9-3cae-4a28-8034-f87c71de61e1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2270907b-6a2e-4eb6-b87c-d0c2bdb1e5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:01 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Volume volume-864041c9-3cae-4a28-8034-f87c71de61e1 (864041c9-3cae-4a28-8034-f87c71de61e1): created successfully Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2270907b-6a2e-4eb6-b87c-d0c2bdb1e5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (9b5b87b3-cc11-4bce-b049-3c97460d92c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3fb4c65f-964f-4b9a-8470-60f7deb9d5c6 tempest-VolumesActionsTest-2080387135 None] Created volume successfully. Jul 05 19:40:01 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 0.827s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:40:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:01 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 Jul 05 19:40:01 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:02 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980" returned: 0 in 0.770s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Acquiring lock "cinder-864041c9-3cae-4a28-8034-f87c71de61e1-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:02 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980 Jul 05 19:40:02 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-864041c9-3cae-4a28-8034-f87c71de61e1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Acquiring lock "cinder-quobyte-864041c9-3cae-4a28-8034-f87c71de61e1" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-quobyte-864041c9-3cae-4a28-8034-f87c71de61e1" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:02 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e606c79-3eb9-45db-84ec-4ef19b312ba3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:02 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1 Jul 05 19:40:02 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:03 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dd5a7cde-c707-4839-9989-fd9c68021980" returned: 0 in 0.669s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-dd5a7cde-c707-4839-9989-fd9c68021980" released by "_delete_snapshot" :: held 3.469s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" released by "delete_snapshot" :: held 3.493s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:03 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Created reservations ['e4cc3c20-33bc-4705-ad4d-9c1336928ffd', '06b38efa-e293-4f81-8a52-d6b5cf950c38', '8316fa43-16fb-4ae2-89bc-579b69e4c417', 'f18b9cf7-e341-4b76-a91a-9dc20e1a13ba'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:03 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Delete snapshot completed successfully. Jul 05 19:40:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68eaf9bf-ff34-44fa-ac7a-294f90d0396e tempest-SnapshotsActionsTest-973165886 None] Lock "cinder-dd5a7cde-c707-4839-9989-fd9c68021980-delete_snapshot" released by "delete_snapshot" :: held 3.642s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:03 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1" returned: 0 in 0.809s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:03 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1 Jul 05 19:40:03 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:04 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-864041c9-3cae-4a28-8034-f87c71de61e1" returned: 0 in 0.697s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-quobyte-864041c9-3cae-4a28-8034-f87c71de61e1" released by "delete_volume" :: held 1.575s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Created reservations ['92a7bfc2-b4fc-4216-afdc-7a3a1decd528', '2fcbe4b0-f2ec-4817-8fae-0c85868e0095', '450be369-299d-4a3b-941d-950c805b6f0c', '548f2b76-2171-4777-942a-880c0f3621af'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "cinder-dcc12d13-f086-41a7-8f56-6ab7290f741d-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:04 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:04 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-dcc12d13-f086-41a7-8f56-6ab7290f741d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "cinder-quobyte-dcc12d13-f086-41a7-8f56-6ab7290f741d" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-quobyte-dcc12d13-f086-41a7-8f56-6ab7290f741d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Deleting offline snapshot dcc12d13-f086-41a7-8f56-6ab7290f741d of volume 11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] snapshot_file for this snap is: volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a817c5c6-b781-47f8-a504-35589a13ff81]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:04 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:40:04 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:05 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.834s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:05 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Deleted volume successfully. Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480ee3de-6da3-4193-8bc6-9ea084c407f2 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-864041c9-3cae-4a28-8034-f87c71de61e1-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:05 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 0.900s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (1f40864c-b56f-4e7a-b20d-9bf9e69b7311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ed0bfb-7ea7-496b-b1cc-a7d609e10a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ff2f0a-fd75-4317-a2e7-223b23b1ba16]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ed0bfb-7ea7-496b-b1cc-a7d609e10a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1522625956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99556f19-f990-4dc9-a9fd-98f698b5e8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:05Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc62a450-1781-442c-9128-8b2aa8b309e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc62a450-1781-442c-9128-8b2aa8b309e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3e9c9d-da11-4c74-912f-fa11472a264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3e9c9d-da11-4c74-912f-fa11472a264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99556f19-f990-4dc9-a9fd-98f698b5e8a6', 'volume_name': 'volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887ee90a-4bfd-4470-87b5-aaa3b9fc38f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887ee90a-4bfd-4470-87b5-aaa3b9fc38f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c16345-e14c-4def-99cf-beaebe2a506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:05 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Volume 99556f19-f990-4dc9-a9fd-98f698b5e8a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6', 'volume_size': 1} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1522625956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99556f19-f990-4dc9-a9fd-98f698b5e8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:05Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Creating volume 99556f19-f990-4dc9-a9fd-98f698b5e8a6 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:40:05 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:40:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:05 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 1073741824 Jul 05 19:40:05 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:05 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 Jul 05 19:40:05 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:06 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10" returned: 0 in 1.000s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:06 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:40:06 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Acquiring lock "cinder-a171cd2f-b493-4ce9-8649-84648e2bc360-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Lock "cinder-a171cd2f-b493-4ce9-8649-84648e2bc360-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:06 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 1073741824" returned: 0 in 1.135s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Acquiring lock "cinder-quobyte-a171cd2f-b493-4ce9-8649-84648e2bc360" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Lock "cinder-quobyte-a171cd2f-b493-4ce9-8649-84648e2bc360" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[20429cde-f169-4189-9346-823a4d591e6f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:06 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 Jul 05 19:40:06 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:06 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 Jul 05 19:40:06 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:07 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 0.971s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:07 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d Jul 05 19:40:07 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:07 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6" returned: 0 in 0.814s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c16345-e14c-4def-99cf-beaebe2a506c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4dd1e-28f1-4b8e-ab16-511950af8a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:07 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Volume volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 (99556f19-f990-4dc9-a9fd-98f698b5e8a6): created successfully Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4dd1e-28f1-4b8e-ab16-511950af8a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (1f40864c-b56f-4e7a-b20d-9bf9e69b7311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:07 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-dcd3da2c-ed62-4042-a728-b77f0ffebb1f tempest-VolumesActionsTest-2080387135 None] Created volume successfully. Jul 05 19:40:07 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360" returned: 0 in 1.039s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:07 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360 Jul 05 19:40:07 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:08 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10.dcc12d13-f086-41a7-8f56-6ab7290f741d" returned: 0 in 0.684s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-quobyte-dcc12d13-f086-41a7-8f56-6ab7290f741d" released by "_delete_snapshot" :: held 3.704s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" released by "delete_snapshot" :: held 3.737s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Created reservations ['a0bae7f8-7356-4017-8da6-ee2e2681d678', '2507ff16-7a16-4cbd-88ac-ec69131b30fb', 'e5e1cd73-5a51-48fc-bef4-2f48bf16264e', 'c7f85b1b-210b-40b7-8ffa-27a6901cd16d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:08 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Delete snapshot completed successfully. Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2b98c70a-af1b-4215-be39-d704fdefe297 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-dcc12d13-f086-41a7-8f56-6ab7290f741d-delete_snapshot" released by "delete_snapshot" :: held 3.878s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:08 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a171cd2f-b493-4ce9-8649-84648e2bc360" returned: 0 in 0.672s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Lock "cinder-quobyte-a171cd2f-b493-4ce9-8649-84648e2bc360" released by "delete_volume" :: held 1.760s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Created reservations ['cf8f47a1-4962-4039-a076-ac14d5fbd6ab', '253ee6e8-3ad9-4cab-b50e-c9a61c209690', 'a99dabd2-7c7f-4572-9b82-e13cb085e9a4', '611d60d0-e4e1-40f7-bd33-d7a9931145a1'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:08 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:08 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "cinder-11ce6365-17f2-45c5-b27b-5bb60f25bd10-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Acquiring lock "cinder-99556f19-f990-4dc9-a9fd-98f698b5e8a6-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-11ce6365-17f2-45c5-b27b-5bb60f25bd10-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-99556f19-f990-4dc9-a9fd-98f698b5e8a6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Acquiring lock "cinder-quobyte-99556f19-f990-4dc9-a9fd-98f698b5e8a6" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-quobyte-99556f19-f990-4dc9-a9fd-98f698b5e8a6" acquired by "delete_volume" :: waited 0.030s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" acquired by "delete_volume" :: waited 0.050s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e900b5-4c25-4d70-8be8-b9d9644c6d77]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2933aed8-f9f0-4369-bcbd-88dedb928913]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:09 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 Jul 05 19:40:09 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:09 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 Jul 05 19:40:09 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:09 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.748s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:09 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:09 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Deleted volume successfully. Jul 05 19:40:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-44909108-bb44-4422-b6bf-e68c02923c36 tempest-TaggedAttachmentsTest-658605207 None] Lock "cinder-a171cd2f-b493-4ce9-8649-84648e2bc360-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:09 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6" returned: 0 in 0.878s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:09 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10" returned: 0 in 0.876s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:09 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6 Jul 05 19:40:09 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:09 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10 Jul 05 19:40:09 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:10 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-99556f19-f990-4dc9-a9fd-98f698b5e8a6" returned: 0 in 0.773s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-quobyte-99556f19-f990-4dc9-a9fd-98f698b5e8a6" released by "delete_volume" :: held 1.729s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:10 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-11ce6365-17f2-45c5-b27b-5bb60f25bd10" returned: 0 in 0.797s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-quobyte-11ce6365-17f2-45c5-b27b-5bb60f25bd10" released by "delete_volume" :: held 1.752s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Created reservations ['c88fa66e-f2ce-4992-97e0-b7eb19fbb445', 'd5116fc3-1833-45b1-aee1-32829f2198c9', '125dffcb-5d96-4f61-878f-8ba9ae5a1449', 'dd0d12b7-cf89-4f5b-982b-bea1978f02bf'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Created reservations ['53a94ada-0830-406f-9cd7-cb1d1f753f17', '49a4be11-ca05-44c7-8a88-2f6319d17cca', '1e7d03bc-c093-44a0-b1af-7e1891bfb987', '2a749ca1-45c3-4614-a8bf-29840828d68e'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:10 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:10 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:10 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:10 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:11 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.047s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Deleted volume successfully. Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7fecc38e-e1f1-4f20-8236-4cfcf9f23776 tempest-VolumesActionsTest-1318173805 None] Lock "cinder-99556f19-f990-4dc9-a9fd-98f698b5e8a6-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:11 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.094s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Deleted volume successfully. Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (0f54b624-b502-4501-9dd5-c35306c61a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e57ea3-5142-4bfb-91dc-68849fd96d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28436efe-0147-4671-9d35-76911075e734 tempest-SnapshotsActionsTest-159033091 None] Lock "cinder-11ce6365-17f2-45c5-b27b-5bb60f25bd10-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e57ea3-5142-4bfb-91dc-68849fd96d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002305511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda836f6-64fa-4713-89a1-0a2ec6b484f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:12Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2886eb-9c47-4e53-a6ec-5ed7653d42ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2886eb-9c47-4e53-a6ec-5ed7653d42ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba5fd17-da7b-45a2-ac61-846dc9624154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba5fd17-da7b-45a2-ac61-846dc9624154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda836f6-64fa-4713-89a1-0a2ec6b484f4', 'volume_name': 'volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ce59b9-1ae2-4af0-97c8-b604482d38cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ce59b9-1ae2-4af0-97c8-b604482d38cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d6ac1d-e0dc-4e6b-b1dd-5dce6ff8507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:12 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Volume eda836f6-64fa-4713-89a1-0a2ec6b484f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4', 'volume_size': 1} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002305511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda836f6-64fa-4713-89a1-0a2ec6b484f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:12Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Creating volume eda836f6-64fa-4713-89a1-0a2ec6b484f4 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:40:12 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:40:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:12 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 1073741824 Jul 05 19:40:12 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:13 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 1073741824" returned: 0 in 1.336s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:13 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 Jul 05 19:40:13 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4" returned: 0 in 0.979s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] <== create_volume: return (2416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:40:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:14 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d6ac1d-e0dc-4e6b-b1dd-5dce6ff8507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70496438-f8e3-4504-a5d3-cf9989d3d761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:14 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Volume volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 (eda836f6-64fa-4713-89a1-0a2ec6b484f4): created successfully Jul 05 19:40:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70496438-f8e3-4504-a5d3-cf9989d3d761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (0f54b624-b502-4501-9dd5-c35306c61a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:14 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3e63e15a-67ba-41db-831b-33fd450b524c tempest-VolumesActionsTest-2080387135 None] Created volume successfully. Jul 05 19:40:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Acquiring lock "cinder-eda836f6-64fa-4713-89a1-0a2ec6b484f4-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Lock "cinder-eda836f6-64fa-4713-89a1-0a2ec6b484f4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Acquiring lock "cinder-quobyte-eda836f6-64fa-4713-89a1-0a2ec6b484f4" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Lock "cinder-quobyte-eda836f6-64fa-4713-89a1-0a2ec6b484f4" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e7b8de-d652-4197-9e08-29014c17d7ed]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:15 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 Jul 05 19:40:15 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:40:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:16 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:16 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:16 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4" returned: 0 in 1.121s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:16 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4 Jul 05 19:40:16 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:18 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.833s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 8 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:40:18 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eda836f6-64fa-4713-89a1-0a2ec6b484f4" returned: 0 in 1.443s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Lock "cinder-quobyte-eda836f6-64fa-4713-89a1-0a2ec6b484f4" released by "delete_volume" :: held 2.628s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Created reservations ['efe00edd-ec10-4716-82f3-098f9a62af1c', '807e48ed-0764-46f5-95da-b04f223501c8', '6b0a3de6-0920-4828-aa1b-3d10bb76fc5c', '3666b7a8-d0f7-400f-9d54-8202b1a3cd75'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:18 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:18 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Flow 'volume_create_manager' (a7c48c7f-5b75-4e8d-a884-78d38d058f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4703463-bd80-4b43-8c3c-b5d78359a035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4703463-bd80-4b43-8c3c-b5d78359a035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-794907250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce3c051-fbd3-4d1d-8307-919422bd48c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84c08490374b2497360363de8408b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:19Z,use_quota=True,user_id='17662fad639741188c8624f5529eca18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5629e964-5cf9-4ca3-aa24-bb9f4a15e0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5629e964-5cf9-4ca3-aa24-bb9f4a15e0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae95ce4-85f7-443b-abdc-2e007b54dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae95ce4-85f7-443b-abdc-2e007b54dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce3c051-fbd3-4d1d-8307-919422bd48c7', 'volume_name': 'volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b076a0a1-1ab4-45b2-aa54-c512d266c674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b076a0a1-1ab4-45b2-aa54-c512d266c674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc944cd7-ebe5-4082-8ba7-e5fd67541c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:19 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Volume 4ce3c051-fbd3-4d1d-8307-919422bd48c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7', 'volume_size': 1} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-794907250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce3c051-fbd3-4d1d-8307-919422bd48c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84c08490374b2497360363de8408b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:19Z,use_quota=True,user_id='17662fad639741188c8624f5529eca18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Creating volume 4ce3c051-fbd3-4d1d-8307-919422bd48c7 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:40:19 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:19 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 1073741824 Jul 05 19:40:19 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:19 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.306s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:19 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Deleted volume successfully. Jul 05 19:40:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-956d49b0-8912-4b39-b5db-cf76fa7e377b tempest-VolumesActionsTest-1318173805 None] Lock "cinder-eda836f6-64fa-4713-89a1-0a2ec6b484f4-delete_volume" released by "delete_volume" :: held 4.315s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (3c2833c8-31b9-4248-b7fe-5f1af72141a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b497c2-74a8-4e9c-8946-dd0dd33230fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b497c2-74a8-4e9c-8946-dd0dd33230fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-596256593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:20Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5622fe9a-8a0c-48ff-8d11-560bd0470bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5622fe9a-8a0c-48ff-8d11-560bd0470bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c8a435-3505-4ee2-993d-85ea07d745da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c8a435-3505-4ee2-993d-85ea07d745da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea', 'volume_name': 'volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14de2c5d-aa93-439f-ac70-011799803e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14de2c5d-aa93-439f-ac70-011799803e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2cbf3c-4ea6-4915-80d9-3c66e9d1a0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:20 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Volume 8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea', 'volume_size': 1} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:20 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 1073741824" returned: 0 in 1.375s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:20 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 Jul 05 19:40:20 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:21 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7" returned: 0 in 0.800s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-596256593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:20Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Creating volume 8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:40:21 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc944cd7-ebe5-4082-8ba7-e5fd67541c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:21 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea 1073741824 Jul 05 19:40:21 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e9e4e4-6772-4262-9b41-e70faad7efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:21 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Volume volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 (4ce3c051-fbd3-4d1d-8307-919422bd48c7): created successfully Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e9e4e4-6772-4262-9b41-e70faad7efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Flow 'volume_create_manager' (a7c48c7f-5b75-4e8d-a884-78d38d058f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:21 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4fdd50a2-30cf-40b1-a1ec-5a62decd9c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Created volume successfully. Jul 05 19:40:22 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea 1073741824" returned: 0 in 1.038s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:22 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea Jul 05 19:40:22 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:23 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea" returned: 0 in 0.738s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.684s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2cbf3c-4ea6-4915-80d9-3c66e9d1a0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360da53-34cc-45a8-9c0b-d2ae651aaaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Creating offline snapshot ebc98860-d48c-4201-9e74-3e681811d83c of volume 4ce3c051-fbd3-4d1d-8307-919422bd48c7 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:40:23 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Volume volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea (8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea): created successfully Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360da53-34cc-45a8-9c0b-d2ae651aaaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (3c2833c8-31b9-4248-b7fe-5f1af72141a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f66fe7-57a8-47d1-af7d-e2d1022de030]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-05e025bc-6891-4371-bfa2-964adf4d4310 tempest-VolumesActionsTest-2080387135 None] Created volume successfully. Jul 05 19:40:23 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 Jul 05 19:40:23 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:24 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7" returned: 0 in 0.854s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:24 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c 1G Jul 05 19:40:24 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Acquiring lock "cinder-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Lock "cinder-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Acquiring lock "cinder-quobyte-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Lock "cinder-quobyte-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea" acquired by "delete_volume" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:25 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b09d2f8-e9b9-4d30-9e21-66fb47e251be]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:25 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea Jul 05 19:40:25 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:25 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c 1G" returned: 0 in 1.281s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:25 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c Jul 05 19:40:25 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:26 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea" returned: 0 in 1.187s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:26 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea Jul 05 19:40:26 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:26 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c" returned: 0 in 0.884s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:26 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c is being set with open permissions: ugo+rw Jul 05 19:40:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:26 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c Jul 05 19:40:26 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:27 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea" returned: 0 in 0.788s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Lock "cinder-quobyte-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea" released by "delete_volume" :: held 2.040s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Created reservations ['bf36add2-4f43-4d69-a833-604d367da34b', '7b88fdaf-631f-4fcc-a77f-10f0150c308d', 'b4c97f6c-049c-48f5-b576-8f3c5001fe15', 'ceadbf2e-c6bf-496d-a8e9-2592f2125d2a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:27 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:27 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:27 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c" returned: 0 in 1.103s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:27 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.info Jul 05 19:40:27 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:28 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.980s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Deleted volume successfully. Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (78327f14-a186-41b7-ab94-8296a27dfc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6d86ad-3108-49b6-acc1-6d27b2fb06d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-11b01e0d-f27b-45ce-bc31-9cbcd6041b4d tempest-VolumesActionsTest-1318173805 None] Lock "cinder-8c62fe77-04b7-4ed2-8bf7-68c3aa4aeeea-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6d86ad-3108-49b6-acc1-6d27b2fb06d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1007108223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbd43de-776c-47ec-92a2-23c957f8e13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:28Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc09f187-04e6-4afd-9232-180fbcb7ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc09f187-04e6-4afd-9232-180fbcb7ca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035b520f-c7c9-4477-bbea-b10c954176e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035b520f-c7c9-4477-bbea-b10c954176e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffbd43de-776c-47ec-92a2-23c957f8e13b', 'volume_name': 'volume-ffbd43de-776c-47ec-92a2-23c957f8e13b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d986417-2833-44c9-b0d7-cf1e1c8a915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d986417-2833-44c9-b0d7-cf1e1c8a915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ae42e3-3eb5-4403-becf-6b25d2c6550c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:28 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Volume ffbd43de-776c-47ec-92a2-23c957f8e13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffbd43de-776c-47ec-92a2-23c957f8e13b', 'volume_size': 1} Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:28 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.info" returned: 0 in 1.026s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:28 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.info is being set with open permissions: ugo+rw Jul 05 19:40:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:28 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.info Jul 05 19:40:28 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:29 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.info" returned: 0 in 0.692s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.019s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.028s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1007108223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbd43de-776c-47ec-92a2-23c957f8e13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1b003aa924f2a816072ebe07fd1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:28Z,use_quota=True,user_id='0eb94e363b7e437895a58b11b714818d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Creating volume ffbd43de-776c-47ec-92a2-23c957f8e13b {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:40:29 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:40:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:29 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b 1073741824 Jul 05 19:40:29 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-cc316583-09f9-4afb-af7f-20717a80141c tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Create snapshot completed successfully Jul 05 19:40:30 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b 1073741824" returned: 0 in 1.211s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:30 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b Jul 05 19:40:30 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Acquiring lock "cinder-ebc98860-d48c-4201-9e74-3e681811d83c-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-ebc98860-d48c-4201-9e74-3e681811d83c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Acquiring lock "cinder-quobyte-4ce3c051-fbd3-4d1d-8307-919422bd48c7" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-quobyte-4ce3c051-fbd3-4d1d-8307-919422bd48c7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Acquiring lock "cinder-quobyte-ebc98860-d48c-4201-9e74-3e681811d83c" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-quobyte-ebc98860-d48c-4201-9e74-3e681811d83c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Deleting offline snapshot ebc98860-d48c-4201-9e74-3e681811d83c of volume 4ce3c051-fbd3-4d1d-8307-919422bd48c7 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] snapshot_file for this snap is: volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6a8e3f-2ce8-4d15-a6e1-2a77b9a59a9d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:31 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c Jul 05 19:40:31 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:31 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b" returned: 0 in 1.020s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ae42e3-3eb5-4403-becf-6b25d2c6550c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbd43de-776c-47ec-92a2-23c957f8e13b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe803b6-8ab3-4785-9879-ce463a1d536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Volume volume-ffbd43de-776c-47ec-92a2-23c957f8e13b (ffbd43de-776c-47ec-92a2-23c957f8e13b): created successfully Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe803b6-8ab3-4785-9879-ce463a1d536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Flow 'volume_create_manager' (78327f14-a186-41b7-ab94-8296a27dfc65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:31 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-11ee8a20-b2f0-459f-8d73-dc2dc328ec7b tempest-VolumesActionsTest-2080387135 None] Created volume successfully. Jul 05 19:40:32 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c" returned: 0 in 1.088s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:40:32 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d40fba-8e88-4778-9b87-d7bbe2cb7842]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:32 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 Jul 05 19:40:32 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:33 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7" returned: 0 in 1.069s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:33 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c Jul 05 19:40:33 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Acquiring lock "cinder-ffbd43de-776c-47ec-92a2-23c957f8e13b-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Lock "cinder-ffbd43de-776c-47ec-92a2-23c957f8e13b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Acquiring lock "cinder-quobyte-ffbd43de-776c-47ec-92a2-23c957f8e13b" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Lock "cinder-quobyte-ffbd43de-776c-47ec-92a2-23c957f8e13b" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c96aead-1970-4ec4-8428-b64bb0b57004]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:33 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b Jul 05 19:40:33 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:34 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c" returned: 0 in 0.811s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:34 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c Jul 05 19:40:34 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:34 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b" returned: 0 in 0.810s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:34 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b Jul 05 19:40:34 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:35 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7.ebc98860-d48c-4201-9e74-3e681811d83c" returned: 0 in 0.664s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-quobyte-ebc98860-d48c-4201-9e74-3e681811d83c" released by "_delete_snapshot" :: held 3.772s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-quobyte-4ce3c051-fbd3-4d1d-8307-919422bd48c7" released by "delete_snapshot" :: held 3.800s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Created reservations ['2ece2c92-fa6b-4f19-9b94-35f0c88558f5', 'cfe3a81e-a4fa-4750-addd-d3f729db3675', '8fe5a5ec-dc54-4668-91cd-f0b87e9070b1', '71f2756f-6240-4acd-88be-bf78338217ca'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Delete snapshot completed successfully. Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0ed7d1c6-9c9a-4fa2-962d-1a13e3c60f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-ebc98860-d48c-4201-9e74-3e681811d83c-delete_snapshot" released by "delete_snapshot" :: held 3.969s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:35 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ffbd43de-776c-47ec-92a2-23c957f8e13b" returned: 0 in 0.716s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Lock "cinder-quobyte-ffbd43de-776c-47ec-92a2-23c957f8e13b" released by "delete_volume" :: held 1.592s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Created reservations ['dfac7108-8421-4b85-a220-6cdcb6a89306', '5acc1fd3-ae86-4095-a57c-09c1218f9f15', '94d0b09a-4bc7-4198-a218-90fdd357fafa', 'bd4bf110-71bf-436e-ae17-05cadf8f82fb'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:35 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:35 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Acquiring lock "cinder-4ce3c051-fbd3-4d1d-8307-919422bd48c7-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-4ce3c051-fbd3-4d1d-8307-919422bd48c7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Acquiring lock "cinder-quobyte-4ce3c051-fbd3-4d1d-8307-919422bd48c7" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-quobyte-4ce3c051-fbd3-4d1d-8307-919422bd48c7" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4affd2-a101-4e26-a6f2-8174f8f0f2d9]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:35 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 Jul 05 19:40:35 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:36 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.810s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:36 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:36 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Deleted volume successfully. Jul 05 19:40:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-135543f9-f273-4893-b74a-4f95258c9ab9 tempest-VolumesActionsTest-2080387135 None] Lock "cinder-ffbd43de-776c-47ec-92a2-23c957f8e13b-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:36 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7" returned: 0 in 0.923s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:36 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7 Jul 05 19:40:36 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:37 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4ce3c051-fbd3-4d1d-8307-919422bd48c7" returned: 0 in 0.778s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-quobyte-4ce3c051-fbd3-4d1d-8307-919422bd48c7" released by "delete_volume" :: held 1.786s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:37 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Created reservations ['5bfec0df-856c-43ff-8abb-dbe214de191c', '434283f1-779e-4dd8-b1b5-65bcb54078c7', '268d6a75-8370-42cd-a2ef-dd441e01f2bc', 'f5b7db2b-d449-4d5b-b7a1-3935287b0fda'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:37 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:37 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:38 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.177s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:38 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:38 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Deleted volume successfully. Jul 05 19:40:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57941c77-17be-4f91-bfea-c97b791e07e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-111830183 None] Lock "cinder-4ce3c051-fbd3-4d1d-8307-919422bd48c7-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:43 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-91236620-fdeb-422f-b80e-1a0732b290a3 req-25e76c26-7560-4eb4-b108-4b62d6a8dd97 tempest-AttachVolumeTestJSON-368282853 None] Terminate volume connection completed successfully. Jul 05 19:40:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-91236620-fdeb-422f-b80e-1a0732b290a3 req-25e76c26-7560-4eb4-b108-4b62d6a8dd97 tempest-AttachVolumeTestJSON-368282853 None] Deleting attachment d01708f4-da94-43fa-9b00-ba772404d563. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Flow 'volume_create_manager' (3eb7659b-cc50-4648-b86d-90881d9160c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1096ac45-e588-4048-a2d2-8686675b4cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1096ac45-e588-4048-a2d2-8686675b4cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1628504897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078e05a9c139480896857fd67639cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:46Z,use_quota=True,user_id='e7d6ed8122a24debbd9a59b49ab3bdff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1612afe8-568a-4c9a-8812-c0456a51f7cf),volume_type_id=1612afe8-568a-4c9a-8812-c0456a51f7cf)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71ced04-b2af-4bd8-bea8-5450636ccb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71ced04-b2af-4bd8-bea8-5450636ccb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9021691-ff30-49a4-91ae-92bf2970a57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9021691-ff30-49a4-91ae-92bf2970a57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b', 'volume_name': 'volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7ed8f0-e376-41f2-b1fa-484e3c683b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7ed8f0-e376-41f2-b1fa-484e3c683b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dc9d41-5088-4882-bbb1-87fa979e30d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:46 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Volume 2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b', 'volume_size': 1} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1628504897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078e05a9c139480896857fd67639cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:46Z,use_quota=True,user_id='e7d6ed8122a24debbd9a59b49ab3bdff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1612afe8-568a-4c9a-8812-c0456a51f7cf),volume_type_id=1612afe8-568a-4c9a-8812-c0456a51f7cf)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Creating volume 2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:40:46 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:40:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:46 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b 1073741824 Jul 05 19:40:46 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:47 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b 1073741824" returned: 0 in 1.069s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:47 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b Jul 05 19:40:47 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:47 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b" returned: 0 in 0.708s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:40:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dc9d41-5088-4882-bbb1-87fa979e30d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e512095-7ec1-434b-a456-2332f4702bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:48 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Volume volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b (2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b): created successfully Jul 05 19:40:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e512095-7ec1-434b-a456-2332f4702bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Flow 'volume_create_manager' (3eb7659b-cc50-4648-b86d-90881d9160c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f16e6a4c-4446-464e-a1c8-cbd2a78e985b tempest-VolumeTypesAccessTest-1674693881 None] Created volume successfully. Jul 05 19:40:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Acquiring lock "cinder-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Lock "cinder-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Acquiring lock "cinder-quobyte-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:40:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Lock "cinder-quobyte-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:40:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[106710ec-d062-4bb9-ae5b-8f1799caf1eb]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:49 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b Jul 05 19:40:49 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:50 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b" returned: 0 in 1.153s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:50 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b Jul 05 19:40:50 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:51 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b" returned: 0 in 0.777s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Lock "cinder-quobyte-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b" released by "delete_volume" :: held 1.982s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:51 devstack cinder-volume[86389]: WARNING cinder.quota [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-420332929 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-420332929, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:40:51 devstack cinder-volume[86389]: WARNING cinder.quota [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-420332929 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-420332929, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:40:51 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Created reservations ['ab7fe792-112d-4b48-b0e4-bb5441542ad6', 'a1ae9657-0ec4-465d-b482-8ce90d19eb2d', 'efb3c0f4-40f2-4af6-81ab-f76cb11b3b2f', '62e2b03f-7c14-48fd-891b-4a0a41a72392'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:40:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:51 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:40:51 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:52 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.832s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:52 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:40:52 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Deleted volume successfully. Jul 05 19:40:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cebcf60d-19ff-4f9f-84cb-c1842b00efd0 tempest-VolumeTypesAccessTest-1674693881 None] Lock "cinder-2186e3d0-7ab8-4350-8d63-cd7b0c2dad8b-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:40:53 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:40:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Flow 'volume_create_manager' (84caa06b-2ebb-4bd7-947b-16c138815881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:40:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5184dee-bb0a-49d1-9859-3dbc1c0072af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5184dee-bb0a-49d1-9859-3dbc1c0072af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-689155891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9b2f01-ff52-42a3-9a0e-14405a166a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b157c631a81947e1b254dadda5eb7506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:53Z,use_quota=True,user_id='8cbfa6e092074dad9d55d2ae8bd78c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9157440c-8476-48b5-8db4-9a20c7b40a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9157440c-8476-48b5-8db4-9a20c7b40a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea59bd7-428d-4343-a907-37dfdabccf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:53 devstack cinder-volume[86389]: DEBUG cinder.image.glance [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Creating Keystone auth plugin from conf {{(pid=86389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 19:40:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea59bd7-428d-4343-a907-37dfdabccf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f9b2f01-ff52-42a3-9a0e-14405a166a65', 'volume_name': 'volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25577b59-1728-4f8f-9b5d-5387e90abe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25577b59-1728-4f8f-9b5d-5387e90abe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:40:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ed6507-7803-49a0-a76c-e67e63e50101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:40:54 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Volume 3f9b2f01-ff52-42a3-9a0e-14405a166a65: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 19:40:54 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Trying to clone 3f9b2f01-ff52-42a3-9a0e-14405a166a65 from image aa12a165-b970-4e97-bb87-7bd652f13413 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]). {{(pid=86389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 19:40:55 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 19:40:55 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Image download 20.69 MB at 20.69 MB/s Jul 05 19:40:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48b275c-d252-42c3-a2db-d932b433cc30]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:55 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD Jul 05 19:40:55 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:56 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD" returned: 0 in 1.240s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:56 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Temporary image aa12a165-b970-4e97-bb87-7bd652f13413 is fetched for user 8cbfa6e092074dad9d55d2ae8bd78c63. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 19:40:56 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=98,cinder:INSERT=32,cinder:UPDATE=121,cinder:DELETE=9 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:40:56 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:INSERT=28,cinder:UPDATE=118,cinder:SELECT=87,cinder:DELETE=9 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:40:56 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f2b4e9-76f1-47f6-97ff-488d8812ca52]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:40:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:57 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD Jul 05 19:40:57 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:40:58 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD" returned: 0 in 1.608s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-689155891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9b2f01-ff52-42a3-9a0e-14405a166a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b157c631a81947e1b254dadda5eb7506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:40:53Z,use_quota=True,user_id='8cbfa6e092074dad9d55d2ae8bd78c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Creating volume 3f9b2f01-ff52-42a3-9a0e-14405a166a65 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:40:58 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:40:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:40:58 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 1073741824 Jul 05 19:40:58 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:00 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 1073741824" returned: 0 in 2.375s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:01 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 Jul 05 19:41:01 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:02 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65" returned: 0 in 1.474s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] <== create_volume: return (3960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:41:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.977s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:02 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Attempting download of aa12a165-b970-4e97-bb87-7bd652f13413 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}])) to volume 3f9b2f01-ff52-42a3-9a0e-14405a166a65. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 19:41:02 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[493ab24d-30cc-40c1-9666-219517dc3ccd]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wy1op11p {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:02 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wy1op11p Jul 05 19:41:02 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:03 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wy1op11p" returned: 0 in 1.318s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wy1op11p {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:04 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wy1op11p Jul 05 19:41:04 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:05 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wy1op11p" returned: 1 in 1.168s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wy1op11p' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:41:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[32580d6f-2ade-4bb2-a8fd-358ce040c6d7]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:05 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD Jul 05 19:41:05 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:06 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD" returned: 0 in 0.950s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:06 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] aa12a165-b970-4e97-bb87-7bd652f13413 was qcow2, converting to raw {{(pid=86389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 19:41:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:06 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 Jul 05 19:41:06 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:06 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:41:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Flow 'volume_create_manager' (941a0d0c-6d04-42ca-85ad-73de3a5ff3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ba4a46-a12a-4ecb-b36b-ec472a8bcfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ba4a46-a12a-4ecb-b36b-ec472a8bcfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-971357469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d36207-b2ee-4c15-9d0f-5391488c4de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40cad57537a5425986f0ce1bdcbf5105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:07Z,use_quota=True,user_id='73512041d8aa4f92a1b812e0e3a2b0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4762298e-0e04-4b4c-91c4-c0e69b8b4cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4762298e-0e04-4b4c-91c4-c0e69b8b4cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb04363-514a-4eab-9230-15696134a678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb04363-514a-4eab-9230-15696134a678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d36207-b2ee-4c15-9d0f-5391488c4de3', 'volume_name': 'volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60092a7-c73f-4566-a552-a007ee97eaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60092a7-c73f-4566-a552-a007ee97eaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff46a0c1-a402-4fb9-93f2-6f22b1288abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:07 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Volume b1d36207-b2ee-4c15-9d0f-5391488c4de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3', 'volume_size': 1} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-971357469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d36207-b2ee-4c15-9d0f-5391488c4de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40cad57537a5425986f0ce1bdcbf5105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:07Z,use_quota=True,user_id='73512041d8aa4f92a1b812e0e3a2b0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Creating volume b1d36207-b2ee-4c15-9d0f-5391488c4de3 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:41:07 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:41:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:07 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 1073741824 Jul 05 19:41:07 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:08 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 1073741824" returned: 0 in 1.094s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:08 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 Jul 05 19:41:08 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:08 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65" returned: 0 in 2.208s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:08 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_545p45z2devstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:41:08 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Converted 112.00 MB image at 50.70 MB/s Jul 05 19:41:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:08 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 1G Jul 05 19:41:08 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:09 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 1G" returned: 0 in 0.806s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:09 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3" returned: 0 in 0.950s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff46a0c1-a402-4fb9-93f2-6f22b1288abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f958206f-783b-4edc-b340-b7351438f5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1874564e-5cda-4f10-8138-5af6b8ab3e1d]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:09 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Volume volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 (b1d36207-b2ee-4c15-9d0f-5391488c4de3): created successfully Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f958206f-783b-4edc-b340-b7351438f5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Flow 'volume_create_manager' (941a0d0c-6d04-42ca-85ad-73de3a5ff3f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:09 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b6624e9b-c377-4edb-b314-85e68cd24330 tempest-SnapshotMetadataTestJSON-1102877918 None] Created volume successfully. Jul 05 19:41:09 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 Jul 05 19:41:09 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:10 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65" returned: 0 in 0.856s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:10 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 Jul 05 19:41:10 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Creating offline snapshot 73bb105f-a47c-492a-8337-ac1d5cc37a03 of volume b1d36207-b2ee-4c15-9d0f-5391488c4de3 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:41:10 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e70ba68-0fdc-4691-8f6b-ef845a699e90]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:10 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 Jul 05 19:41:10 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:11 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65" returned: 1 in 1.150s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Downloaded image aa12a165-b970-4e97-bb87-7bd652f13413 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}])) to volume 3f9b2f01-ff52-42a3-9a0e-14405a166a65 successfully. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Temporary image aa12a165-b970-4e97-bb87-7bd652f13413 for user 8cbfa6e092074dad9d55d2ae8bd78c63 is deleted. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Marking volume 3f9b2f01-ff52-42a3-9a0e-14405a166a65 as bootable. {{(pid=86389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Copying metadata from image aa12a165-b970-4e97-bb87-7bd652f13413 to 3f9b2f01-ff52-42a3-9a0e-14405a166a65. {{(pid=86389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Creating volume glance metadata for volume 3f9b2f01-ff52-42a3-9a0e-14405a166a65 backed by image aa12a165-b970-4e97-bb87-7bd652f13413 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 19:41:11 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3" returned: 0 in 0.968s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:11 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 1G Jul 05 19:41:11 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ed6507-7803-49a0-a76c-e67e63e50101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e8a2ba-1b00-4dac-8679-c291a0161b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:11 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Volume volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 (3f9b2f01-ff52-42a3-9a0e-14405a166a65): created successfully Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e8a2ba-1b00-4dac-8679-c291a0161b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Flow 'volume_create_manager' (84caa06b-2ebb-4bd7-947b-16c138815881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-30d725dc-3152-4958-b38d-aed531c9112a tempest-VolumesImageMetadata-421181121 None] Created volume successfully. Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Acquiring lock "cinder-3f9b2f01-ff52-42a3-9a0e-14405a166a65-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Lock "cinder-3f9b2f01-ff52-42a3-9a0e-14405a166a65-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Acquiring lock "cinder-quobyte-3f9b2f01-ff52-42a3-9a0e-14405a166a65" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Lock "cinder-quobyte-3f9b2f01-ff52-42a3-9a0e-14405a166a65" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[539c5456-8605-4f09-ba8f-b4025958f40c]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:12 devstack sudo[92027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 Jul 05 19:41:12 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:12 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 1G" returned: 0 in 0.873s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:12 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 Jul 05 19:41:12 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:12 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65" returned: 0 in 0.796s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:12 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03" returned: 0 in 0.694s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:12 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 is being set with open permissions: ugo+rw Jul 05 19:41:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:12 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 Jul 05 19:41:12 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:12 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 Jul 05 19:41:12 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:13 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03" returned: 0 in 0.641s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:13 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65" returned: 1 in 0.768s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:41:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:13 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.info Jul 05 19:41:13 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:13 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65 Jul 05 19:41:13 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:14 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3f9b2f01-ff52-42a3-9a0e-14405a166a65" returned: 0 in 0.662s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Lock "cinder-quobyte-3f9b2f01-ff52-42a3-9a0e-14405a166a65" released by "delete_volume" :: held 2.285s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:14 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.info" returned: 0 in 0.700s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:14 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.info is being set with open permissions: ugo+rw Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:14 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.info Jul 05 19:41:14 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Created reservations ['77e5e32a-866d-4147-820c-e14a016d5945', 'aaf01141-9e2f-47fc-af3c-676a729c851d', 'c4430f30-5d21-425c-a4c3-d33fb9a546da', '3b8f3073-025b-4eb6-872b-c35b5eae3b3d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:14 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:41:14 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:14 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.info" returned: 0 in 0.668s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.654s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:14 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b481e5eb-dcdc-4d25-b485-1ec905c890b6 tempest-SnapshotMetadataTestJSON-1102877918 None] Create snapshot completed successfully Jul 05 19:41:15 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.678s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:15 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:41:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Deleted volume successfully. Jul 05 19:41:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-857356b5-999f-4b4e-8187-c7f5c103340f tempest-VolumesImageMetadata-421181121 None] Lock "cinder-3f9b2f01-ff52-42a3-9a0e-14405a166a65-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:16 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:41:16 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Acquiring lock "cinder-73bb105f-a47c-492a-8337-ac1d5cc37a03-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-73bb105f-a47c-492a-8337-ac1d5cc37a03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Acquiring lock "cinder-quobyte-b1d36207-b2ee-4c15-9d0f-5391488c4de3" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-quobyte-b1d36207-b2ee-4c15-9d0f-5391488c4de3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Acquiring lock "cinder-quobyte-73bb105f-a47c-492a-8337-ac1d5cc37a03" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-quobyte-73bb105f-a47c-492a-8337-ac1d5cc37a03" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Deleting offline snapshot 73bb105f-a47c-492a-8337-ac1d5cc37a03 of volume b1d36207-b2ee-4c15-9d0f-5391488c4de3 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] snapshot_file for this snap is: volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45f9730-c17c-41c2-a0b9-c4bb72482917]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:16 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 Jul 05 19:41:16 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:16 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.790s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:41:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:41:17 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03" returned: 0 in 0.836s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:41:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[305bb274-f444-4da0-bbca-e13a6b5875c6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:17 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 Jul 05 19:41:17 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:17 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3" returned: 0 in 0.788s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:18 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 Jul 05 19:41:18 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Flow 'volume_create_manager' (02ce3c24-bef7-4b9a-9663-f2401d834727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b25de09-4309-4365-93fe-8e5276acb6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b25de09-4309-4365-93fe-8e5276acb6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-225876680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5b87fc-b9ee-47aa-95aa-766f26e6fea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df0607095c24ecdb61208f0310402e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:18Z,use_quota=True,user_id='c0049b869ef5481080d7b6b9aa86c2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef7d2bc-07c4-40e7-9af0-906849d55fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef7d2bc-07c4-40e7-9af0-906849d55fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843d3570-0e1d-4589-9203-b9b816d9e3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843d3570-0e1d-4589-9203-b9b816d9e3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5b87fc-b9ee-47aa-95aa-766f26e6fea9', 'volume_name': 'volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b60ec8-1fdf-4dbd-bbd9-f4b9562b3803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b60ec8-1fdf-4dbd-bbd9-f4b9562b3803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bac1ce-8618-4e45-9a4e-966f8a47fd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:18 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Volume 2f5b87fc-b9ee-47aa-95aa-766f26e6fea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9', 'volume_size': 1} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-225876680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5b87fc-b9ee-47aa-95aa-766f26e6fea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df0607095c24ecdb61208f0310402e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:18Z,use_quota=True,user_id='c0049b869ef5481080d7b6b9aa86c2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Creating volume 2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:41:18 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:18 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 1073741824 Jul 05 19:41:18 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:18 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03" returned: 0 in 0.761s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:18 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03 Jul 05 19:41:18 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:19 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 1073741824" returned: 0 in 0.902s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:19 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 Jul 05 19:41:19 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:19 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3.73bb105f-a47c-492a-8337-ac1d5cc37a03" returned: 0 in 0.756s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-quobyte-73bb105f-a47c-492a-8337-ac1d5cc37a03" released by "_delete_snapshot" :: held 3.258s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-quobyte-b1d36207-b2ee-4c15-9d0f-5391488c4de3" released by "delete_snapshot" :: held 3.284s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:19 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Created reservations ['fe93adac-2475-44c2-bd6f-6c77fb546a71', '231cb449-6c6a-40cf-b794-c083f8422adf', '360019ff-9c8b-451e-81cd-a7d06ecc60e2', '6fb4f56b-1f3e-4238-9fd0-1f3a781310ad'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:41:19 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Delete snapshot completed successfully. Jul 05 19:41:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e24ebe78-baf2-4b75-a0f2-6b558ca46818 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-73bb105f-a47c-492a-8337-ac1d5cc37a03-delete_snapshot" released by "delete_snapshot" :: held 3.436s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:20 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9" returned: 0 in 0.664s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bac1ce-8618-4e45-9a4e-966f8a47fd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5237044e-073f-4a8e-bd91-85bc17d4c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:20 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Volume volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 (2f5b87fc-b9ee-47aa-95aa-766f26e6fea9): created successfully Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5237044e-073f-4a8e-bd91-85bc17d4c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Flow 'volume_create_manager' (02ce3c24-bef7-4b9a-9663-f2401d834727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5d870bbe-ceb0-4509-9657-dfdefa1fc315 tempest-VolumesMetadataTest-319326268 None] Created volume successfully. Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Acquiring lock "cinder-b1d36207-b2ee-4c15-9d0f-5391488c4de3-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-b1d36207-b2ee-4c15-9d0f-5391488c4de3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Acquiring lock "cinder-quobyte-b1d36207-b2ee-4c15-9d0f-5391488c4de3" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-quobyte-b1d36207-b2ee-4c15-9d0f-5391488c4de3" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8208e14-f700-488e-844a-5afcccba8a33]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:20 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 Jul 05 19:41:20 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Acquiring lock "cinder-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Lock "cinder-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Acquiring lock "cinder-quobyte-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Lock "cinder-quobyte-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:21 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d345043f-14ef-4403-a237-978cd7aa9cc7]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:21 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 Jul 05 19:41:21 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:21 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3" returned: 0 in 0.818s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:21 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3 Jul 05 19:41:21 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:22 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9" returned: 0 in 0.789s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:22 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9 Jul 05 19:41:22 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:22 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b1d36207-b2ee-4c15-9d0f-5391488c4de3" returned: 0 in 0.679s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-quobyte-b1d36207-b2ee-4c15-9d0f-5391488c4de3" released by "delete_volume" :: held 1.569s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Created reservations ['f0697016-59d2-4342-a1dc-f6551713e66d', '5f6389a6-8678-4b37-ab30-7b678b2eb084', '6f69b3bd-4013-4e8a-9ad6-ea1be5146663', 'ea7b3add-cc17-4846-9f27-777fd8159540'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:22 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:41:22 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:22 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9" returned: 0 in 0.781s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Lock "cinder-quobyte-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9" released by "delete_volume" :: held 1.612s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:22 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Created reservations ['65209415-8bfa-490d-9810-ec1ae7987c39', '0badc7c8-a6b0-405e-980c-04d2e0fa17ac', '32cec330-4793-4bb1-89b9-067cd1c4c605', 'ffa5dff4-56ba-4ea8-bfc8-990e9982c651'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:23 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:41:23 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:23 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.814s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:41:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Deleted volume successfully. Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-752e5b4c-ff91-4742-894f-bc1891051d40 tempest-SnapshotMetadataTestJSON-1102877918 None] Lock "cinder-b1d36207-b2ee-4c15-9d0f-5391488c4de3-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Flow 'volume_create_manager' (fb4f8d78-ca0a-40a5-884a-d2e8b77028a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f853f8-61e6-4fde-aeb4-d825d7f07dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f853f8-61e6-4fde-aeb4-d825d7f07dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1433818705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23f5904-0939-447d-beea-37126c482f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5739460077714eecb5d9d66e869d41c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:23Z,use_quota=True,user_id='6fa746baedd6402b9b0d54ee74010737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feae4481-728e-47ae-90c1-4356ed0d226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feae4481-728e-47ae-90c1-4356ed0d226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d984e7-1d9d-43b4-8aa5-2144bc3d66f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d984e7-1d9d-43b4-8aa5-2144bc3d66f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23f5904-0939-447d-beea-37126c482f71', 'volume_name': 'volume-a23f5904-0939-447d-beea-37126c482f71', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1ee23c-7bea-4fd0-8650-3cd3058eaf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1ee23c-7bea-4fd0-8650-3cd3058eaf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a49a39-7797-4d71-9813-4ef524e462d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:23 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Volume a23f5904-0939-447d-beea-37126c482f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23f5904-0939-447d-beea-37126c482f71', 'volume_size': 1} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1433818705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23f5904-0939-447d-beea-37126c482f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5739460077714eecb5d9d66e869d41c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:23Z,use_quota=True,user_id='6fa746baedd6402b9b0d54ee74010737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Creating volume a23f5904-0939-447d-beea-37126c482f71 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:41:23 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:41:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:23 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 1073741824 Jul 05 19:41:23 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:24 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.152s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:24 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:41:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Deleted volume successfully. Jul 05 19:41:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-adb5fbb2-eaa1-43f2-b68a-168cdf114fb1 tempest-VolumesMetadataTest-319326268 None] Lock "cinder-2f5b87fc-b9ee-47aa-95aa-766f26e6fea9-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:25 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 1073741824" returned: 0 in 1.382s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:25 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 Jul 05 19:41:25 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:26 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71" returned: 0 in 0.847s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:41:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a49a39-7797-4d71-9813-4ef524e462d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23f5904-0939-447d-beea-37126c482f71', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1013e57-cfe9-42dd-a082-610e9854afb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:26 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Volume volume-a23f5904-0939-447d-beea-37126c482f71 (a23f5904-0939-447d-beea-37126c482f71): created successfully Jul 05 19:41:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1013e57-cfe9-42dd-a082-610e9854afb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Flow 'volume_create_manager' (fb4f8d78-ca0a-40a5-884a-d2e8b77028a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c84a5578-f98a-493b-8ad5-c3f9a89fbe97 tempest-ServerActionsTestOtherA-1830110092 None] Created volume successfully. Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Flow 'volume_create_manager' (5fba3028-7be0-4d26-996c-a18cac3bf8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9c1c76-6a3d-4e3c-ad8d-5926c5b84cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9c1c76-6a3d-4e3c-ad8d-5926c5b84cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-134686934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd153b8-bca9-4620-9377-88b409787448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7922a188556044d384825b134f772b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:29Z,use_quota=True,user_id='a75b57001f894a6babdcd2f3654b8926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1633a949-e46a-441b-9e36-3395bf20da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1633a949-e46a-441b-9e36-3395bf20da09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384153de-5b72-4c05-9eb8-ea73dd7714db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.image.glance [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Creating Keystone auth plugin from conf {{(pid=86389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Flow 'volume_create_manager' (dd39b3eb-4cd2-4e20-8c27-429c9f6a19c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56a1934-8023-4afc-af6e-149924c58582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56a1934-8023-4afc-af6e-149924c58582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-344414225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ab2f6e-2bef-47f8-838d-b9647ac771d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77391b0b65f44b1a780d1d701a7b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:30Z,use_quota=True,user_id='8d8e2dc118cc4b38b69ca978e12205c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b0e8f9-4197-4d24-b34d-c848418bb79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b0e8f9-4197-4d24-b34d-c848418bb79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f97d0d5-5883-4689-b705-fdf6afeddd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f97d0d5-5883-4689-b705-fdf6afeddd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ab2f6e-2bef-47f8-838d-b9647ac771d7', 'volume_name': 'volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe2970b-3a09-43f1-96c8-d5e6a6b9afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe2970b-3a09-43f1-96c8-d5e6a6b9afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff626ea-133f-4d28-a590-12535ca3125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Volume a7ab2f6e-2bef-47f8-838d-b9647ac771d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7', 'volume_size': 1} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-344414225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ab2f6e-2bef-47f8-838d-b9647ac771d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77391b0b65f44b1a780d1d701a7b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:30Z,use_quota=True,user_id='8d8e2dc118cc4b38b69ca978e12205c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Creating volume a7ab2f6e-2bef-47f8-838d-b9647ac771d7 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:41:29 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:29 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 1073741824 Jul 05 19:41:29 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384153de-5b72-4c05-9eb8-ea73dd7714db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4dd153b8-bca9-4620-9377-88b409787448', 'volume_name': 'volume-4dd153b8-bca9-4620-9377-88b409787448', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784f5130-982d-4fe1-a128-f48733f6e222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784f5130-982d-4fe1-a128-f48733f6e222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78345a0d-4e1c-4033-9d1f-f9fd18ea6ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:29 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Volume 4dd153b8-bca9-4620-9377-88b409787448: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4dd153b8-bca9-4620-9377-88b409787448', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 19:41:29 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Trying to clone 4dd153b8-bca9-4620-9377-88b409787448 from image aa12a165-b970-4e97-bb87-7bd652f13413 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]). {{(pid=86389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 19:41:30 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 19:41:30 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Image download 20.69 MB at 20.69 MB/s Jul 05 19:41:30 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac51bb6-0297-45fb-a7ae-8d58a7a2f678]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:30 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD Jul 05 19:41:30 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:30 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 1073741824" returned: 0 in 0.958s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:30 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 Jul 05 19:41:30 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:31 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Temporary image aa12a165-b970-4e97-bb87-7bd652f13413 is fetched for user a75b57001f894a6babdcd2f3654b8926. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bbd486-5023-40da-b978-0874cc06d7f9]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:31 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD Jul 05 19:41:31 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:31 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7" returned: 0 in 0.725s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff626ea-133f-4d28-a590-12535ca3125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f211ac-fc86-4257-a6bc-5afb2ff1c460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Volume volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 (a7ab2f6e-2bef-47f8-838d-b9647ac771d7): created successfully Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f211ac-fc86-4257-a6bc-5afb2ff1c460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Flow 'volume_create_manager' (dd39b3eb-4cd2-4e20-8c27-429c9f6a19c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:31 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-659707f3-6cbd-4d28-91f8-4de937e32eaf tempest-VolumesTransfersTest-890460235 None] Created volume successfully. Jul 05 19:41:31 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-134686934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd153b8-bca9-4620-9377-88b409787448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7922a188556044d384825b134f772b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:29Z,use_quota=True,user_id='a75b57001f894a6babdcd2f3654b8926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Creating volume 4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:41:32 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:41:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:32 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 1073741824 Jul 05 19:41:32 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:32 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-75e249cf-2c92-4836-8408-54cca8fe3db6 tempest-VolumesTransfersTest-1633311724 None] Transfer volume completed successfully. Jul 05 19:41:33 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 1073741824" returned: 0 in 0.991s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:33 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 Jul 05 19:41:33 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Acquiring lock "cinder-a7ab2f6e-2bef-47f8-838d-b9647ac771d7-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Lock "cinder-a7ab2f6e-2bef-47f8-838d-b9647ac771d7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Acquiring lock "cinder-quobyte-a7ab2f6e-2bef-47f8-838d-b9647ac771d7" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Lock "cinder-quobyte-a7ab2f6e-2bef-47f8-838d-b9647ac771d7" acquired by "delete_volume" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ff0133-cf69-46b9-825f-eac169d56c25]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:33 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 Jul 05 19:41:33 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:33 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448" returned: 0 in 0.796s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Attempting download of aa12a165-b970-4e97-bb87-7bd652f13413 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}])) to volume 4dd153b8-bca9-4620-9377-88b409787448. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef658f55-955a-424f-a3fe-09dcb7a01a51]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wi2nqe7v {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:34 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wi2nqe7v Jul 05 19:41:34 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:34 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7" returned: 0 in 1.084s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:34 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7 Jul 05 19:41:34 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:35 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wi2nqe7v" returned: 0 in 1.065s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wi2nqe7v {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:35 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wi2nqe7v Jul 05 19:41:35 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:35 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a7ab2f6e-2bef-47f8-838d-b9647ac771d7" returned: 0 in 0.994s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Lock "cinder-quobyte-a7ab2f6e-2bef-47f8-838d-b9647ac771d7" released by "delete_volume" :: held 2.155s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Created reservations ['4c66e644-d689-4b19-bb78-75fa6fefda04', '424a0d67-d2d8-41f7-9a89-59416317e54f', '64225ead-8413-4311-9048-1cdf60591ae9', '62ac55ac-2747-4b7b-9159-46049769f62d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:41:35 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wi2nqe7v" returned: 1 in 0.985s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_wi2nqe7v' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a285be5-cd3c-446b-a01c-78c92ea20434]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:36 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:41:36 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:36 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD Jul 05 19:41:36 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:36 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.855s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:41:36 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Deleted volume successfully. Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-521c7357-8787-4448-89c6-5bb5b05086d7 tempest-VolumesTransfersTest-176505757 None] Lock "cinder-a7ab2f6e-2bef-47f8-838d-b9647ac771d7-delete_volume" released by "delete_volume" :: held 3.352s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:36 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD" returned: 0 in 0.955s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] aa12a165-b970-4e97-bb87-7bd652f13413 was qcow2, converting to raw {{(pid=86389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 19:41:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:37 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 Jul 05 19:41:37 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Flow 'volume_create_manager' (647758c6-3f8c-4e42-8aeb-a7b837521369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49fe7d1-8a41-499e-b6f0-42dc541a9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49fe7d1-8a41-499e-b6f0-42dc541a9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1100325505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff05d2a0-71ad-4e8d-a3c1-6351414be63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77391b0b65f44b1a780d1d701a7b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:37Z,use_quota=True,user_id='8d8e2dc118cc4b38b69ca978e12205c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7603fd28-dcb6-436b-9af8-f9e5ac18ea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7603fd28-dcb6-436b-9af8-f9e5ac18ea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2003f95a-805b-46f4-9e2a-21236223c223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2003f95a-805b-46f4-9e2a-21236223c223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff05d2a0-71ad-4e8d-a3c1-6351414be63a', 'volume_name': 'volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709faed7-4ae9-47bb-8c6b-d6df647d364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709faed7-4ae9-47bb-8c6b-d6df647d364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96618a88-54b4-443c-b6f3-a64a970b4bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:37 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Volume ff05d2a0-71ad-4e8d-a3c1-6351414be63a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a', 'volume_size': 1} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1100325505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff05d2a0-71ad-4e8d-a3c1-6351414be63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77391b0b65f44b1a780d1d701a7b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:37Z,use_quota=True,user_id='8d8e2dc118cc4b38b69ca978e12205c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Creating volume ff05d2a0-71ad-4e8d-a3c1-6351414be63a {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:41:37 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:41:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:37 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a 1073741824 Jul 05 19:41:37 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:38 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a 1073741824" returned: 0 in 1.003s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:38 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a Jul 05 19:41:38 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:39 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448" returned: 0 in 2.207s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_iaoxweoadevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:41:39 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Converted 112.00 MB image at 50.71 MB/s Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:39 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 1G Jul 05 19:41:39 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:39 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a" returned: 0 in 0.713s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96618a88-54b4-443c-b6f3-a64a970b4bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa91cf06-d726-4e09-afb4-addfdc70f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:39 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Volume volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a (ff05d2a0-71ad-4e8d-a3c1-6351414be63a): created successfully Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa91cf06-d726-4e09-afb4-addfdc70f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Flow 'volume_create_manager' (647758c6-3f8c-4e42-8aeb-a7b837521369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:39 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0309018d-d4ce-438a-a11f-6385ec287dbf tempest-VolumesTransfersTest-890460235 None] Created volume successfully. Jul 05 19:41:40 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 1G" returned: 0 in 1.056s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b130a78-1d88-4fb6-b48d-c72136a1520b]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Acquiring lock "cinder-ff05d2a0-71ad-4e8d-a3c1-6351414be63a-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Lock "cinder-ff05d2a0-71ad-4e8d-a3c1-6351414be63a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Acquiring lock "cinder-quobyte-ff05d2a0-71ad-4e8d-a3c1-6351414be63a" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Lock "cinder-quobyte-ff05d2a0-71ad-4e8d-a3c1-6351414be63a" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ec52d-344d-49ad-aac4-e8089ea9e4f6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:40 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 Jul 05 19:41:40 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:40 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a Jul 05 19:41:40 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:41 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448" returned: 0 in 1.077s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:41 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 Jul 05 19:41:41 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:41 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a" returned: 0 in 1.179s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:41 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a Jul 05 19:41:41 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:42 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448" returned: 1 in 1.141s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Downloaded image aa12a165-b970-4e97-bb87-7bd652f13413 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}])) to volume 4dd153b8-bca9-4620-9377-88b409787448 successfully. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Temporary image aa12a165-b970-4e97-bb87-7bd652f13413 for user a75b57001f894a6babdcd2f3654b8926 is deleted. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Marking volume 4dd153b8-bca9-4620-9377-88b409787448 as bootable. {{(pid=86389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Copying metadata from image aa12a165-b970-4e97-bb87-7bd652f13413 to 4dd153b8-bca9-4620-9377-88b409787448. {{(pid=86389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Creating volume glance metadata for volume 4dd153b8-bca9-4620-9377-88b409787448 backed by image aa12a165-b970-4e97-bb87-7bd652f13413 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78345a0d-4e1c-4033-9d1f-f9fd18ea6ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd153b8-bca9-4620-9377-88b409787448', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1956d21-4dc4-421a-8d49-b7a05225a5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:42 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Volume volume-4dd153b8-bca9-4620-9377-88b409787448 (4dd153b8-bca9-4620-9377-88b409787448): created successfully Jul 05 19:41:42 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1956d21-4dc4-421a-8d49-b7a05225a5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Flow 'volume_create_manager' (5fba3028-7be0-4d26-996c-a18cac3bf8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff05d2a0-71ad-4e8d-a3c1-6351414be63a" returned: 0 in 1.110s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4dc712fd-c580-463d-87c2-571982d4c4df tempest-VolumesExtendTest-126912897 None] Created volume successfully. Jul 05 19:41:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Lock "cinder-quobyte-ff05d2a0-71ad-4e8d-a3c1-6351414be63a" released by "delete_volume" :: held 2.372s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Created reservations ['b5ecf5ad-5e1e-4372-9273-107e86f7b83d', '08b7457c-d987-4800-bba2-14aff45daa09', '876ce33a-05c2-4b85-b786-1944f0e49bb3', '9c2e143c-4b08-41b0-9c05-1db50cd4a3be'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:43 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:41:43 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e40d35b-56ec-4fa5-88dd-013c25812dd3]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:44 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 Jul 05 19:41:44 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:44 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.942s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:44 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:41:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Deleted volume successfully. Jul 05 19:41:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c4ea23c-8e6a-4f4f-80a6-a6c4bfdbacf1 tempest-VolumesTransfersTest-176505757 None] Lock "cinder-ff05d2a0-71ad-4e8d-a3c1-6351414be63a-delete_volume" released by "delete_volume" :: held 3.803s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:45 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448" returned: 0 in 1.238s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:45 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 Jul 05 19:41:45 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:46 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448" returned: 1 in 1.152s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:41:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 2G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 2G" returned: 0 in 0.083s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.566s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8b0f398a-14ba-4aa0-9da8-a38acff32bab tempest-VolumesExtendTest-126912897 None] Extend volume completed successfully. Jul 05 19:41:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Acquiring lock "cinder-4dd153b8-bca9-4620-9377-88b409787448-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Lock "cinder-4dd153b8-bca9-4620-9377-88b409787448-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Acquiring lock "cinder-quobyte-4dd153b8-bca9-4620-9377-88b409787448" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:41:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Lock "cinder-quobyte-4dd153b8-bca9-4620-9377-88b409787448" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:41:47 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[db11c603-537a-4e58-82b5-04faeef48216]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:47 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 Jul 05 19:41:47 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:48 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448" returned: 0 in 1.358s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:49 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 Jul 05 19:41:49 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:50 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448" returned: 1 in 1.409s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:41:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:50 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448 Jul 05 19:41:50 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:51 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4dd153b8-bca9-4620-9377-88b409787448" returned: 0 in 1.074s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Lock "cinder-quobyte-4dd153b8-bca9-4620-9377-88b409787448" released by "delete_volume" :: held 3.968s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:51 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Created reservations ['58d5fd12-7a7f-411b-a733-35ac8b70e89f', 'fc5caff9-714f-4ac7-ae90-f1e8f381bdbb', 'ad9b7387-2f9f-4e07-b53b-28004857c999', '2c7c01eb-7010-449a-944a-5e61948b5410'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:41:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:51 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:41:51 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:53 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.594s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:41:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Deleted volume successfully. Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Flow 'volume_create_manager' (3d93191b-0985-4e26-a46d-2fbf73a1f7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9381b243-9ad4-4b4a-a5d9-5bd9d511d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e9449068-931f-4d9d-80c7-ed7f7dbcf786 tempest-VolumesExtendTest-126912897 None] Lock "cinder-4dd153b8-bca9-4620-9377-88b409787448-delete_volume" released by "delete_volume" :: held 5.907s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9381b243-9ad4-4b4a-a5d9-5bd9d511d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1063681998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77698473-6953-4cf6-8de6-6912e44e2a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7922a188556044d384825b134f772b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:53Z,use_quota=True,user_id='a75b57001f894a6babdcd2f3654b8926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6403b6-74c0-4a9c-b0d5-1f4a05156957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6403b6-74c0-4a9c-b0d5-1f4a05156957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6931165-c0ad-4487-a26b-106abbfb2477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6931165-c0ad-4487-a26b-106abbfb2477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77698473-6953-4cf6-8de6-6912e44e2a99', 'volume_name': 'volume-77698473-6953-4cf6-8de6-6912e44e2a99', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108adecd-e4dd-4c87-aa5e-6125934477fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108adecd-e4dd-4c87-aa5e-6125934477fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38b151e-febe-4f62-8cf6-8a3566d64ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:53 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Volume 77698473-6953-4cf6-8de6-6912e44e2a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77698473-6953-4cf6-8de6-6912e44e2a99', 'volume_size': 1} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1063681998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77698473-6953-4cf6-8de6-6912e44e2a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7922a188556044d384825b134f772b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:53Z,use_quota=True,user_id='a75b57001f894a6babdcd2f3654b8926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Creating volume 77698473-6953-4cf6-8de6-6912e44e2a99 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:41:53 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:53 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 1073741824 Jul 05 19:41:53 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Flow 'volume_create_manager' (f4b81349-0794-46ec-bc1b-9dae7d211d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e816001-2a61-4eeb-80bb-c8a348ae5bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e816001-2a61-4eeb-80bb-c8a348ae5bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-40940846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7115df7d-9cd5-4271-a21c-85b12296e09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585fd5efaec7483a97cdf3a992c6a628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:54Z,use_quota=True,user_id='a6a88fd2d4934f3e80c027b3df6cd712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a94328-0dc6-4c0b-a53d-eca9c1161717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a94328-0dc6-4c0b-a53d-eca9c1161717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e9ad33-3398-4d32-8826-2c2b2d882797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e9ad33-3398-4d32-8826-2c2b2d882797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7115df7d-9cd5-4271-a21c-85b12296e09f', 'volume_name': 'volume-7115df7d-9cd5-4271-a21c-85b12296e09f', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494b3284-2a1a-49f3-838a-1f495129076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494b3284-2a1a-49f3-838a-1f495129076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f8c8b6-c051-460d-98ea-c8f591199614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:54 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Volume 7115df7d-9cd5-4271-a21c-85b12296e09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7115df7d-9cd5-4271-a21c-85b12296e09f', 'volume_size': 1} Jul 05 19:41:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:54 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 1073741824" returned: 0 in 1.239s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:54 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 Jul 05 19:41:54 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:55 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99" returned: 0 in 0.804s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-40940846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7115df7d-9cd5-4271-a21c-85b12296e09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585fd5efaec7483a97cdf3a992c6a628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:54Z,use_quota=True,user_id='a6a88fd2d4934f3e80c027b3df6cd712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Creating volume 7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:41:55 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38b151e-febe-4f62-8cf6-8a3566d64ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77698473-6953-4cf6-8de6-6912e44e2a99', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:55 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f 1073741824 Jul 05 19:41:55 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b639d6-4d79-424f-aab1-ac977f834d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:55 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Volume volume-77698473-6953-4cf6-8de6-6912e44e2a99 (77698473-6953-4cf6-8de6-6912e44e2a99): created successfully Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b639d6-4d79-424f-aab1-ac977f834d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Flow 'volume_create_manager' (3d93191b-0985-4e26-a46d-2fbf73a1f7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:55 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0a288045-8efc-4a54-a976-c2abd577a28c tempest-VolumesExtendTest-126912897 None] Created volume successfully. Jul 05 19:41:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:56 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f 1073741824" returned: 0 in 1.271s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:56 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f Jul 05 19:41:56 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:57 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f" returned: 0 in 0.697s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.954s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=89,cinder:SELECT=72,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:INSERT=37,cinder:SELECT=75,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f8c8b6-c051-460d-98ea-c8f591199614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7115df7d-9cd5-4271-a21c-85b12296e09f', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc1e72e-4456-4b05-9276-e996d298f8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Creating offline snapshot 130195fe-cf05-490b-bfa8-3a3b743e3086 of volume 77698473-6953-4cf6-8de6-6912e44e2a99 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9f357-2441-40b9-bfaf-3f469c6262b3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:57 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Volume volume-7115df7d-9cd5-4271-a21c-85b12296e09f (7115df7d-9cd5-4271-a21c-85b12296e09f): created successfully Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc1e72e-4456-4b05-9276-e996d298f8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Flow 'volume_create_manager' (f4b81349-0794-46ec-bc1b-9dae7d211d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:57 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b9cef5db-4768-4ed0-bf00-6e5f777a8a4c tempest-VolumesCloneTest-1033718275 None] Created volume successfully. Jul 05 19:41:57 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 Jul 05 19:41:57 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:58 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99" returned: 0 in 0.839s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:58 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 1G Jul 05 19:41:58 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Flow 'volume_create_manager' (c2d7e3b5-7136-48ed-b8c4-274b99507385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a89da4-3e0b-44fc-8f2c-779f372ef7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a89da4-3e0b-44fc-8f2c-779f372ef7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-184815984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585fd5efaec7483a97cdf3a992c6a628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:41:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7115df7d-9cd5-4271-a21c-85b12296e09f,status='creating',terminated_at=None,updated_at=2026-07-05T17:41:59Z,use_quota=True,user_id='a6a88fd2d4934f3e80c027b3df6cd712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e161980c-c49e-47c9-8015-5dbd8f09ba37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e161980c-c49e-47c9-8015-5dbd8f09ba37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044b13f4-10aa-456f-9ce0-5b1a6e03895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044b13f4-10aa-456f-9ce0-5b1a6e03895e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a', 'volume_name': 'volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a', 'volume_size': 2, 'source_volid': '7115df7d-9cd5-4271-a21c-85b12296e09f', 'source_volstatus': 'available'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5395b74-d915-438a-b392-3dad6900f7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5395b74-d915-438a-b392-3dad6900f7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da9d79b-65a9-4096-9447-ef124a873b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:41:58 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Volume 7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a', 'volume_size': 2, 'source_volid': '7115df7d-9cd5-4271-a21c-85b12296e09f', 'source_volstatus': 'available'} Jul 05 19:41:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:41:59 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Jul 05 19:41:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 1G" returned: 0 in 0.974s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:41:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77698473-6953-4cf6-8de6-6912e44e2a99 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:41:59 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77698473-6953-4cf6-8de6-6912e44e2a99 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 Jul 05 19:41:59 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:00 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77698473-6953-4cf6-8de6-6912e44e2a99 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086" returned: 0 in 0.718s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:00 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 is being set with open permissions: ugo+rw Jul 05 19:42:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:00 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 Jul 05 19:42:00 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:00 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086" returned: 0 in 0.679s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:00 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.info Jul 05 19:42:00 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:01 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.info" returned: 0 in 0.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:01 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.info is being set with open permissions: ugo+rw Jul 05 19:42:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:01 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.info Jul 05 19:42:01 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:02 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.info" returned: 0 in 0.697s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.743s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.389s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:02 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Cloning volume 7115df7d-9cd5-4271-a21c-85b12296e09f to volume 7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a Jul 05 19:42:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-bdb7ef8e-d97a-418a-ace4-21dd7471468c tempest-VolumesExtendTest-126912897 None] Create snapshot completed successfully Jul 05 19:42:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Creating offline snapshot fe6f620a-1203-4780-ac3c-1666af13c585 of volume 7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:42:02 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8249f60-2e36-4f86-8526-150af986e3c9]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:02 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f Jul 05 19:42:02 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-60322f9e-3e8b-46c8-a595-142478853996 tempest-VolumesExtendTest-126912897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:03 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f" returned: 0 in 0.949s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:03 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 1G Jul 05 19:42:03 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:04 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 1G" returned: 0 in 0.833s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7115df7d-9cd5-4271-a21c-85b12296e09f -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:04 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7115df7d-9cd5-4271-a21c-85b12296e09f -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 Jul 05 19:42:04 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:04 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7115df7d-9cd5-4271-a21c-85b12296e09f -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585" returned: 0 in 0.742s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:04 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 is being set with open permissions: ugo+rw Jul 05 19:42:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:04 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 Jul 05 19:42:04 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:05 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585" returned: 0 in 0.657s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:05 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.info Jul 05 19:42:05 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:06 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.info" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:06 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.info is being set with open permissions: ugo+rw Jul 05 19:42:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:06 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.info Jul 05 19:42:06 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:06 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.info" returned: 0 in 0.671s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Acquiring lock "cinder-quobyte-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Lock "cinder-quobyte-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] snapshot: fe6f620a-1203-4780-ac3c-1666af13c585, volume: 7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b77b71-ab8d-465c-8159-06a302dd8eb3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:07 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 Jul 05 19:42:07 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:07 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585" returned: 0 in 0.746s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7115df7d-9cd5-4271-a21c-85b12296e09f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acb2241-7e66-49b7-88d2-b2ffeb52a38c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:07 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f Jul 05 19:42:07 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:08 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f" returned: 0 in 0.736s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:08 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:42:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:08 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a Jul 05 19:42:08 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-9c421e3a-4ca5-4027-b2ab-3c3417763b69 req-49f48021-d8cf-4084-8204-f67960a11e36 tempest-ServerActionsTestOtherA-1830110092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:13 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" returned: 0 in 5.283s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d08467-0d85-4902-9d50-26735934c4f5]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:13 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f Jul 05 19:42:13 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:14 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f" returned: 0 in 0.973s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:14 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:42:14 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Converted 1024.00 MB image at 193.81 MB/s Jul 05 19:42:14 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a is being set with open permissions: ugo+rw Jul 05 19:42:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:14 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a Jul 05 19:42:14 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:15 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" returned: 0 in 0.648s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Lock "cinder-quobyte-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" released by "_copy_volume_from_snapshot" :: held 8.466s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Acquiring lock "cinder-quobyte-fe6f620a-1203-4780-ac3c-1666af13c585" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Lock "cinder-quobyte-fe6f620a-1203-4780-ac3c-1666af13c585" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Deleting offline snapshot fe6f620a-1203-4780-ac3c-1666af13c585 of volume 7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:42:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] snapshot_file for this snap is: volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:42:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[67312064-6a6e-4362-ba8c-ec2c5056034b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:15 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 Jul 05 19:42:15 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:16 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:42:16 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:16 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585" returned: 0 in 0.785s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7115df7d-9cd5-4271-a21c-85b12296e09f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[263649c0-3857-47fd-bb56-951e621af67c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:16 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f Jul 05 19:42:16 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:16 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Flow 'volume_create_manager' (d13307b4-31da-4bbd-9d42-34f688ea1148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ed5976-3024-4a67-8d12-fabc35547a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ed5976-3024-4a67-8d12-fabc35547a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-888001241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8712d616-3f54-47a6-905b-a2bb45fcc1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffda385a0e9f4eb5a8d80a3584aaa90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:17Z,use_quota=True,user_id='2be56327e486410f91d42d01ff094699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d2b45d-9b86-43ce-b98a-2be4c40333da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d2b45d-9b86-43ce-b98a-2be4c40333da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabb1245-2a86-40c9-ac88-e5d717fb404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabb1245-2a86-40c9-ac88-e5d717fb404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8712d616-3f54-47a6-905b-a2bb45fcc1b7', 'volume_name': 'volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c264be55-0fdf-4c11-8965-e9e3149584fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c264be55-0fdf-4c11-8965-e9e3149584fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7dff4d-dacc-4443-b4dd-5d697a07bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:16 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Volume 8712d616-3f54-47a6-905b-a2bb45fcc1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7', 'volume_size': 1} Jul 05 19:42:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:17 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f" returned: 0 in 0.817s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:17 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 Jul 05 19:42:17 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:17 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585" returned: 0 in 0.732s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:17 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585 Jul 05 19:42:17 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:18 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f.fe6f620a-1203-4780-ac3c-1666af13c585" returned: 0 in 0.650s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Lock "cinder-quobyte-fe6f620a-1203-4780-ac3c-1666af13c585" released by "_delete_snapshot" :: held 3.080s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.303s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-60322f9e-3e8b-46c8-a595-142478853996 tempest-VolumesExtendTest-126912897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 15.441s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da9d79b-65a9-4096-9447-ef124a873b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a', 'volume_size': 2, 'source_volid': '7115df7d-9cd5-4271-a21c-85b12296e09f', 'source_volstatus': 'available'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4644c674-900f-4d56-a5fc-864a3c674100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f005bd8-4c79-4ae6-b24b-5fd78fa71df4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-60322f9e-3e8b-46c8-a595-142478853996 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:18 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Volume volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a (7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a): created successfully Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4644c674-900f-4d56-a5fc-864a3c674100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Flow 'volume_create_manager' (c2d7e3b5-7136-48ed-b8c4-274b99507385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:18 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1177e66b-4faa-4fd0-a019-33ddb4cfd563 tempest-VolumesCloneTest-1033718275 None] Created volume successfully. Jul 05 19:42:18 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 Jul 05 19:42:18 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:19 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-60322f9e-3e8b-46c8-a595-142478853996 tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99" returned: 0 in 0.765s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-60322f9e-3e8b-46c8-a595-142478853996 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 2G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Acquiring lock "cinder-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Lock "cinder-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Acquiring lock "cinder-quobyte-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Lock "cinder-quobyte-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a099e13c-0edc-4e37-ada4-9e9c1c92ee71]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-60322f9e-3e8b-46c8-a595-142478853996 tempest-VolumesExtendTest-126912897 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 2G" returned: 0 in 0.161s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-60322f9e-3e8b-46c8-a595-142478853996 tempest-VolumesExtendTest-126912897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.972s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-9c421e3a-4ca5-4027-b2ab-3c3417763b69 req-49f48021-d8cf-4084-8204-f67960a11e36 tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.492s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f7a47-5741-4f5f-b93c-0a925d1a87be]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-9c421e3a-4ca5-4027-b2ab-3c3417763b69 req-49f48021-d8cf-4084-8204-f67960a11e36 tempest-ServerActionsTestOtherA-1830110092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:19 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-60322f9e-3e8b-46c8-a595-142478853996 tempest-VolumesExtendTest-126912897 None] Extend volume completed successfully. Jul 05 19:42:19 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a Jul 05 19:42:19 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:19 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 Jul 05 19:42:19 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:20 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" returned: 0 in 0.796s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:20 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a Jul 05 19:42:20 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:20 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-9c421e3a-4ca5-4027-b2ab-3c3417763b69 req-49f48021-d8cf-4084-8204-f67960a11e36 tempest-ServerActionsTestOtherA-1830110092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71" returned: 0 in 0.805s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-9c421e3a-4ca5-4027-b2ab-3c3417763b69 req-49f48021-d8cf-4084-8204-f67960a11e36 tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.828s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.422s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-888001241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8712d616-3f54-47a6-905b-a2bb45fcc1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffda385a0e9f4eb5a8d80a3584aaa90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:17Z,use_quota=True,user_id='2be56327e486410f91d42d01ff094699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Creating volume 8712d616-3f54-47a6-905b-a2bb45fcc1b7 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:42:20 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:20 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 1073741824 Jul 05 19:42:20 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-9c421e3a-4ca5-4027-b2ab-3c3417763b69 req-49f48021-d8cf-4084-8204-f67960a11e36 tempest-ServerActionsTestOtherA-1830110092 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-a23f5904-0939-447d-beea-37126c482f71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25a1c71f-0c7d-441e-92af-d84f70c1201a', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:42:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-9c421e3a-4ca5-4027-b2ab-3c3417763b69 req-49f48021-d8cf-4084-8204-f67960a11e36 tempest-ServerActionsTestOtherA-1830110092 None] attachment_update completed successfully. Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Acquiring lock "cinder-130195fe-cf05-490b-bfa8-3a3b743e3086-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Lock "cinder-130195fe-cf05-490b-bfa8-3a3b743e3086-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Acquiring lock "cinder-quobyte-77698473-6953-4cf6-8de6-6912e44e2a99" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Lock "cinder-quobyte-77698473-6953-4cf6-8de6-6912e44e2a99" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Acquiring lock "cinder-quobyte-130195fe-cf05-490b-bfa8-3a3b743e3086" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Lock "cinder-quobyte-130195fe-cf05-490b-bfa8-3a3b743e3086" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Deleting offline snapshot 130195fe-cf05-490b-bfa8-3a3b743e3086 of volume 77698473-6953-4cf6-8de6-6912e44e2a99 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] snapshot_file for this snap is: volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb35fb5d-f3c6-48e0-9301-504aa5e749a2]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:21 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 Jul 05 19:42:21 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:21 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" returned: 0 in 0.733s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Lock "cinder-quobyte-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a" released by "delete_volume" :: held 1.572s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Created reservations ['bf2ca247-c3d7-4232-be80-91ff920e2b48', 'a92b0eb6-96c7-4a13-b0e9-4fdbbae8c61d', '26dc28ac-77d3-4d03-ab8b-5ffea4b201a2', '0c1c2ef7-10e5-48b4-be1e-84b0e6fe6177'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:21 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:42:21 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:21 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 1073741824" returned: 0 in 0.994s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:21 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 Jul 05 19:42:21 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Acquiring lock "cinder-7115df7d-9cd5-4271-a21c-85b12296e09f-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Lock "cinder-7115df7d-9cd5-4271-a21c-85b12296e09f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Acquiring lock "cinder-quobyte-7115df7d-9cd5-4271-a21c-85b12296e09f" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Lock "cinder-quobyte-7115df7d-9cd5-4271-a21c-85b12296e09f" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:21 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086" returned: 0 in 1.084s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77698473-6953-4cf6-8de6-6912e44e2a99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab9fc92-6d2e-4b26-9ba9-95e757722c44]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54602ca-be45-48b6-900e-a2974b352922]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:22 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.844s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:42:22 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Deleted volume successfully. Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fd52deef-ee03-4bc7-ae87-79df6a487f9f tempest-VolumesCloneTest-1033718275 None] Lock "cinder-7d8a5aa9-e69f-4a5d-bad1-22e2bc06333a-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:22 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f Jul 05 19:42:22 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:22 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 Jul 05 19:42:22 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:22 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7" returned: 0 in 0.789s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7dff4d-dacc-4443-b4dd-5d697a07bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0612c7-ed6c-43cb-9318-ef1a592bc3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:22 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Volume volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 (8712d616-3f54-47a6-905b-a2bb45fcc1b7): created successfully Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0612c7-ed6c-43cb-9318-ef1a592bc3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Flow 'volume_create_manager' (d13307b4-31da-4bbd-9d42-34f688ea1148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:22 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6d7bbf93-c918-4474-8aeb-304c557c7da3 tempest-AttachVolumeTestJSON-368282853 None] Created volume successfully. Jul 05 19:42:22 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f" returned: 0 in 0.844s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:22 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99" returned: 0 in 0.839s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:22 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f Jul 05 19:42:22 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:22 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 Jul 05 19:42:22 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:23 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7115df7d-9cd5-4271-a21c-85b12296e09f" returned: 0 in 0.696s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Lock "cinder-quobyte-7115df7d-9cd5-4271-a21c-85b12296e09f" released by "delete_volume" :: held 1.626s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Created reservations ['ba5fc023-d8d0-4034-bf24-d5e68f33b850', '00047ca3-546b-473a-af85-e3ab01e16c9b', '0f6eb88c-3afc-40cc-bab3-55a72b18cfb8', '859150f2-fc2c-46e4-aca5-829c5d4790df'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:23 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086" returned: 0 in 0.836s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:23 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:42:23 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:23 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086 Jul 05 19:42:23 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:24 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:24 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:42:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Deleted volume successfully. Jul 05 19:42:24 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99.130195fe-cf05-490b-bfa8-3a3b743e3086" returned: 0 in 0.715s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f450e8c7-552e-4ec4-b794-baf0c46a559b tempest-VolumesCloneTest-1033718275 None] Lock "cinder-7115df7d-9cd5-4271-a21c-85b12296e09f-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Lock "cinder-quobyte-130195fe-cf05-490b-bfa8-3a3b743e3086" released by "_delete_snapshot" :: held 3.616s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Lock "cinder-quobyte-77698473-6953-4cf6-8de6-6912e44e2a99" released by "delete_snapshot" :: held 3.647s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:24 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Created reservations ['8b473906-ae52-4f30-aa33-7f1959867331', '27e3e28c-e4b7-4d6a-8c48-2d4c3184b250', 'e78dab87-bd2d-4602-a1d7-661adda0480f', '40b77acd-06e6-4428-86ec-1076cde32461'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:42:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Delete snapshot completed successfully. Jul 05 19:42:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d9f679f8-6701-4207-85ed-e5a90d079160 tempest-VolumesExtendTest-126912897 None] Lock "cinder-130195fe-cf05-490b-bfa8-3a3b743e3086-delete_snapshot" released by "delete_snapshot" :: held 3.813s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Acquiring lock "cinder-77698473-6953-4cf6-8de6-6912e44e2a99-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Lock "cinder-77698473-6953-4cf6-8de6-6912e44e2a99-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Acquiring lock "cinder-quobyte-77698473-6953-4cf6-8de6-6912e44e2a99" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Lock "cinder-quobyte-77698473-6953-4cf6-8de6-6912e44e2a99" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:25 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f780e7-7421-4144-abff-f3ee5ae0285c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:25 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 Jul 05 19:42:25 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:26 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99" returned: 0 in 1.029s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:26 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99 Jul 05 19:42:26 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f991260a-7f07-486e-89f0-003ebe20ec67 req-3c423682-37c1-45a1-b8e7-7498956df1e8 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f991260a-7f07-486e-89f0-003ebe20ec67 req-3c423682-37c1-45a1-b8e7-7498956df1e8 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:26 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41aea60-5c7e-417b-883c-c26f924a0fe2]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f991260a-7f07-486e-89f0-003ebe20ec67 req-3c423682-37c1-45a1-b8e7-7498956df1e8 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:26 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 Jul 05 19:42:26 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:27 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-77698473-6953-4cf6-8de6-6912e44e2a99" returned: 0 in 0.761s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Lock "cinder-quobyte-77698473-6953-4cf6-8de6-6912e44e2a99" released by "delete_volume" :: held 1.865s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Created reservations ['cc559c88-3189-4c22-987a-1fbd88fcd471', 'b59d7c40-948a-4193-8f8d-cb7ff60bb549', '1034bec4-e7ae-4c6e-8140-34e2bd5232a1', '4138cc1c-1d1c-46a9-91b1-ffff99241c83'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:27 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:42:27 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Flow 'volume_create_manager' (2c5c8cfb-ddfb-4054-b5ce-95a2a24731e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b1d4ac-0e04-42c1-a0c4-3cb44f5ca15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b1d4ac-0e04-42c1-a0c4-3cb44f5ca15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1919767220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8deef730-0168-4574-b090-77de61cb0fd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cb8a2b2364046e0808253b5a5e11b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:28Z,use_quota=True,user_id='86a0d89cbcfc469caf07da9d4224b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7234d26e-3881-4915-8b21-f48153ab155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:27 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7234d26e-3881-4915-8b21-f48153ab155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f11c941-3674-46e7-8444-7215d9286c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f11c941-3674-46e7-8444-7215d9286c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8deef730-0168-4574-b090-77de61cb0fd0', 'volume_name': 'volume-8deef730-0168-4574-b090-77de61cb0fd0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8172259d-919e-4e11-aaea-b58870288614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8172259d-919e-4e11-aaea-b58870288614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0072a17a-c74c-478e-b202-395a161b4ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:27 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Volume 8deef730-0168-4574-b090-77de61cb0fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8deef730-0168-4574-b090-77de61cb0fd0', 'volume_size': 1} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f991260a-7f07-486e-89f0-003ebe20ec67 req-3c423682-37c1-45a1-b8e7-7498956df1e8 tempest-AttachVolumeTestJSON-368282853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7" returned: 0 in 1.024s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f991260a-7f07-486e-89f0-003ebe20ec67 req-3c423682-37c1-45a1-b8e7-7498956df1e8 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.047s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1919767220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8deef730-0168-4574-b090-77de61cb0fd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cb8a2b2364046e0808253b5a5e11b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:28Z,use_quota=True,user_id='86a0d89cbcfc469caf07da9d4224b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Creating volume 8deef730-0168-4574-b090-77de61cb0fd0 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:42:27 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:27 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0 1073741824 Jul 05 19:42:27 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f991260a-7f07-486e-89f0-003ebe20ec67 req-3c423682-37c1-45a1-b8e7-7498956df1e8 tempest-AttachVolumeTestJSON-368282853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe196e59-a8f5-476c-b01a-0dcc05bcd0a4', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:42:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-f991260a-7f07-486e-89f0-003ebe20ec67 req-3c423682-37c1-45a1-b8e7-7498956df1e8 tempest-AttachVolumeTestJSON-368282853 None] attachment_update completed successfully. Jul 05 19:42:28 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.853s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:28 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:42:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Deleted volume successfully. Jul 05 19:42:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1b1136dc-fe9f-448c-8480-d805dbf6f6b1 tempest-VolumesExtendTest-126912897 None] Lock "cinder-77698473-6953-4cf6-8de6-6912e44e2a99-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-e938b025-bc07-4df6-8af4-bcbf35f94526 req-9dd83bd8-d6dd-44a3-9137-af9d1396f255 tempest-ServerActionsTestOtherA-1830110092 None] Terminate volume connection completed successfully. Jul 05 19:42:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-e938b025-bc07-4df6-8af4-bcbf35f94526 req-9dd83bd8-d6dd-44a3-9137-af9d1396f255 tempest-ServerActionsTestOtherA-1830110092 None] Deleting attachment 25a1c71f-0c7d-441e-92af-d84f70c1201a. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:42:28 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0 1073741824" returned: 0 in 1.145s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:29 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0 Jul 05 19:42:29 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:30 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0" returned: 0 in 1.020s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0072a17a-c74c-478e-b202-395a161b4ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8deef730-0168-4574-b090-77de61cb0fd0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e113609b-a378-41be-a241-03449404bc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:30 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Volume volume-8deef730-0168-4574-b090-77de61cb0fd0 (8deef730-0168-4574-b090-77de61cb0fd0): created successfully Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e113609b-a378-41be-a241-03449404bc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Flow 'volume_create_manager' (2c5c8cfb-ddfb-4054-b5ce-95a2a24731e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:30 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-70cae36a-515f-4d8c-a72e-b4dc28657fec tempest-VolumesListTestJSON-1061605090 None] Created volume successfully. Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-e938b025-bc07-4df6-8af4-bcbf35f94526 req-78a28697-43b6-4148-be04-be1e52d27f4e tempest-ServerActionsTestOtherA-1830110092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-e938b025-bc07-4df6-8af4-bcbf35f94526 req-78a28697-43b6-4148-be04-be1e52d27f4e tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[596d900b-cc6d-4d0c-8c1f-a5d6c283e25a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-e938b025-bc07-4df6-8af4-bcbf35f94526 req-78a28697-43b6-4148-be04-be1e52d27f4e tempest-ServerActionsTestOtherA-1830110092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:30 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 Jul 05 19:42:30 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (443ca4e5-1ab8-4537-810d-d6addd5f01e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05508d2d-f6e3-41ac-8216-29ee96b0d3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05508d2d-f6e3-41ac-8216-29ee96b0d3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1511325612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f17ece-a054-4ac7-8a04-a4b106c9e68a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:31Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e876dd53-b14a-44b9-a037-84c06ada6d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e876dd53-b14a-44b9-a037-84c06ada6d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b1ce46-d11f-4394-8d81-10ef06c222fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b1ce46-d11f-4394-8d81-10ef06c222fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f17ece-a054-4ac7-8a04-a4b106c9e68a', 'volume_name': 'volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186bf608-d75a-4769-906b-412cf54b1928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186bf608-d75a-4769-906b-412cf54b1928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4c25ed-a1dc-42e0-a35e-aecb8922fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Volume a4f17ece-a054-4ac7-8a04-a4b106c9e68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a', 'volume_size': 1} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:31 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-e938b025-bc07-4df6-8af4-bcbf35f94526 req-78a28697-43b6-4148-be04-be1e52d27f4e tempest-ServerActionsTestOtherA-1830110092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71" returned: 0 in 0.838s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-e938b025-bc07-4df6-8af4-bcbf35f94526 req-78a28697-43b6-4148-be04-be1e52d27f4e tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.860s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.299s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1511325612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f17ece-a054-4ac7-8a04-a4b106c9e68a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:31Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Creating volume a4f17ece-a054-4ac7-8a04-a4b106c9e68a {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:42:31 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:31 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a 1073741824 Jul 05 19:42:31 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-e938b025-bc07-4df6-8af4-bcbf35f94526 req-78a28697-43b6-4148-be04-be1e52d27f4e tempest-ServerActionsTestOtherA-1830110092 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-a23f5904-0939-447d-beea-37126c482f71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3636b2d-17e4-4af0-a56c-a56b3ba00890', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:42:31 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-e938b025-bc07-4df6-8af4-bcbf35f94526 req-78a28697-43b6-4148-be04-be1e52d27f4e tempest-ServerActionsTestOtherA-1830110092 None] attachment_update completed successfully. Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Flow 'volume_create_manager' (c18a6381-0121-48ba-a724-1a4e88998bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c168c3e-020a-441a-b458-7269cd6d8748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c168c3e-020a-441a-b458-7269cd6d8748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-989325212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2374c145-c85e-4358-85f3-0a5fb7a0a3a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cb8a2b2364046e0808253b5a5e11b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:32Z,use_quota=True,user_id='86a0d89cbcfc469caf07da9d4224b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbee682-ddf9-4975-82df-3d02b343b665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbee682-ddf9-4975-82df-3d02b343b665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2af3056-03c3-41fe-a242-034b0e6c40b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2af3056-03c3-41fe-a242-034b0e6c40b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2374c145-c85e-4358-85f3-0a5fb7a0a3a3', 'volume_name': 'volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e14d14-5919-4ae0-9efe-1fc2584d328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e14d14-5919-4ae0-9efe-1fc2584d328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6c160b-5451-4593-b995-014d9c5c8d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Volume 2374c145-c85e-4358-85f3-0a5fb7a0a3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3', 'volume_size': 1} Jul 05 19:42:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:32 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a 1073741824" returned: 0 in 0.911s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:32 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a Jul 05 19:42:32 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Flow 'volume_create_manager' (0ad1d6f0-2c96-47ed-94c0-df15bf2f63c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51acb04-1258-4254-91c8-6452bb361cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51acb04-1258-4254-91c8-6452bb361cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-603959631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc17aba3-7539-4622-b412-e83189953984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffda385a0e9f4eb5a8d80a3584aaa90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:33Z,use_quota=True,user_id='2be56327e486410f91d42d01ff094699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd875384-6371-4294-88e6-74bbe85b1597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd875384-6371-4294-88e6-74bbe85b1597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add1abbf-db14-43c6-9f85-1078a68aef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add1abbf-db14-43c6-9f85-1078a68aef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc17aba3-7539-4622-b412-e83189953984', 'volume_name': 'volume-fc17aba3-7539-4622-b412-e83189953984', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d801302-0e0c-4ea9-a9c1-460889d272f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d801302-0e0c-4ea9-a9c1-460889d272f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3031e01-f16a-436c-a3a5-4fdc672bad18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:33 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Volume fc17aba3-7539-4622-b412-e83189953984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc17aba3-7539-4622-b412-e83189953984', 'volume_size': 1} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:33 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a" returned: 0 in 0.701s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-989325212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2374c145-c85e-4358-85f3-0a5fb7a0a3a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cb8a2b2364046e0808253b5a5e11b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:32Z,use_quota=True,user_id='86a0d89cbcfc469caf07da9d4224b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Creating volume 2374c145-c85e-4358-85f3-0a5fb7a0a3a3 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:42:33 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4c25ed-a1dc-42e0-a35e-aecb8922fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896012bb-775d-420b-83f7-06a8f9f4697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:33 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 1073741824 Jul 05 19:42:33 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:33 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Volume volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a (a4f17ece-a054-4ac7-8a04-a4b106c9e68a): created successfully Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896012bb-775d-420b-83f7-06a8f9f4697c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (443ca4e5-1ab8-4537-810d-d6addd5f01e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8ee9a297-87a2-420a-944f-ae4b68b52d89 tempest-VolumesGetTest-860026711 None] Created volume successfully. Jul 05 19:42:34 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 1073741824" returned: 0 in 0.876s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:34 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 Jul 05 19:42:34 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:34 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3" returned: 0 in 0.681s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:42:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.884s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-603959631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc17aba3-7539-4622-b412-e83189953984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffda385a0e9f4eb5a8d80a3584aaa90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:33Z,use_quota=True,user_id='2be56327e486410f91d42d01ff094699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:42:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Creating volume fc17aba3-7539-4622-b412-e83189953984 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:42:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:42:35 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6c160b-5451-4593-b995-014d9c5c8d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:35 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 1073741824 Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2738c6-39a3-4817-afe1-6726cc47291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:35 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:35 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Volume volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 (2374c145-c85e-4358-85f3-0a5fb7a0a3a3): created successfully Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2738c6-39a3-4817-afe1-6726cc47291c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Flow 'volume_create_manager' (c18a6381-0121-48ba-a724-1a4e88998bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fee8b702-26a4-42d9-ad06-80b560d6de61 tempest-VolumesListTestJSON-1061605090 None] Created volume successfully. Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (8b1ab285-3530-4afd-bfe2-c6cfcccb180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b84e84-2fe9-43b5-a1bf-e72a3bf285e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b84e84-2fe9-43b5-a1bf-e72a3bf285e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1034286543',display_name='tempest-VolumesGetTest-Volume-1500959361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7c0b6b-9f16-46a4-8748-b95abfdec137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:35Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255ea43b-a454-440c-98b7-bd1be0c36b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255ea43b-a454-440c-98b7-bd1be0c36b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d94e4ba-1d32-4698-b61f-e4b5abaafb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d94e4ba-1d32-4698-b61f-e4b5abaafb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7c0b6b-9f16-46a4-8748-b95abfdec137', 'volume_name': 'volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5191f52e-0a5b-4496-bd79-99558eaee48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5191f52e-0a5b-4496-bd79-99558eaee48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2ce52c-e562-4bec-a142-f3e42cd8a1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:35 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Volume ce7c0b6b-9f16-46a4-8748-b95abfdec137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137', 'volume_size': 1} Jul 05 19:42:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:36 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 1073741824" returned: 0 in 1.023s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:36 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 Jul 05 19:42:36 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Flow 'volume_create_manager' (c99a1ec1-3081-4bf7-9c7e-065718ceece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a7b4ef-dfba-4fe5-9f62-bd8f3c794395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a7b4ef-dfba-4fe5-9f62-bd8f3c794395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1208313918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da71c617-e25a-4971-984b-8f1f499fc41d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cb8a2b2364046e0808253b5a5e11b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:37Z,use_quota=True,user_id='86a0d89cbcfc469caf07da9d4224b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24eb89b6-10b6-4a08-ad9d-cd6e8aebaff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24eb89b6-10b6-4a08-ad9d-cd6e8aebaff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cc9500-29ec-4f80-931d-7a55a41c3930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cc9500-29ec-4f80-931d-7a55a41c3930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da71c617-e25a-4971-984b-8f1f499fc41d', 'volume_name': 'volume-da71c617-e25a-4971-984b-8f1f499fc41d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cfbf64-8512-499a-8ec3-e7e8f29945eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cfbf64-8512-499a-8ec3-e7e8f29945eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5215d088-80c5-45df-a2ab-d981ae97c7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:36 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Volume da71c617-e25a-4971-984b-8f1f499fc41d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da71c617-e25a-4971-984b-8f1f499fc41d', 'volume_size': 1} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:36 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984" returned: 0 in 0.889s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1034286543',display_name='tempest-VolumesGetTest-Volume-1500959361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7c0b6b-9f16-46a4-8748-b95abfdec137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:35Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Creating volume ce7c0b6b-9f16-46a4-8748-b95abfdec137 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:42:36 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:42:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3031e01-f16a-436c-a3a5-4fdc672bad18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc17aba3-7539-4622-b412-e83189953984', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:37 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 1073741824 Jul 05 19:42:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14e2526-764a-4ebf-8703-ffad80eb1554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:37 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:37 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Volume volume-fc17aba3-7539-4622-b412-e83189953984 (fc17aba3-7539-4622-b412-e83189953984): created successfully Jul 05 19:42:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14e2526-764a-4ebf-8703-ffad80eb1554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Flow 'volume_create_manager' (0ad1d6f0-2c96-47ed-94c0-df15bf2f63c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:37 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0cbe8501-edca-4278-a570-10166f270800 tempest-AttachVolumeTestJSON-368282853 None] Created volume successfully. Jul 05 19:42:37 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 1073741824" returned: 0 in 0.887s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:37 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 Jul 05 19:42:37 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:38 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137" returned: 0 in 0.639s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1208313918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da71c617-e25a-4971-984b-8f1f499fc41d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cb8a2b2364046e0808253b5a5e11b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:37Z,use_quota=True,user_id='86a0d89cbcfc469caf07da9d4224b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Creating volume da71c617-e25a-4971-984b-8f1f499fc41d {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:42:38 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2ce52c-e562-4bec-a142-f3e42cd8a1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:38 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d 1073741824 Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a687a6a-aedb-4cb8-9339-c118b4a6d886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:38 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:38 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Volume volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 (ce7c0b6b-9f16-46a4-8748-b95abfdec137): created successfully Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a687a6a-aedb-4cb8-9339-c118b4a6d886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (8b1ab285-3530-4afd-bfe2-c6cfcccb180d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:38 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-51dcaf14-8326-492a-9b9a-f6392b0a7e64 tempest-VolumesGetTest-860026711 None] Created volume successfully. Jul 05 19:42:39 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d 1073741824" returned: 0 in 1.034s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:39 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d Jul 05 19:42:39 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-ce7c0b6b-9f16-46a4-8748-b95abfdec137-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Lock "cinder-ce7c0b6b-9f16-46a4-8748-b95abfdec137-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-quobyte-ce7c0b6b-9f16-46a4-8748-b95abfdec137" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-ce7c0b6b-9f16-46a4-8748-b95abfdec137" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:39 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e8c3aa-c835-4e7a-bbc0-489e91a00283]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:40 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 Jul 05 19:42:40 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-a0187e65-5d5f-4139-8014-eca0632a9314 req-12825f00-9a2b-4ced-add5-b4ec959e1e2d tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:40 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d" returned: 0 in 1.028s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-a0187e65-5d5f-4139-8014-eca0632a9314 req-12825f00-9a2b-4ced-add5-b4ec959e1e2d tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.118s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5215d088-80c5-45df-a2ab-d981ae97c7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da71c617-e25a-4971-984b-8f1f499fc41d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c521d833-f2f4-4c33-8620-ea0872b1fef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57f0aaa-b5a6-4f70-987c-77982454ca6f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-a0187e65-5d5f-4139-8014-eca0632a9314 req-12825f00-9a2b-4ced-add5-b4ec959e1e2d tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:40 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Volume volume-da71c617-e25a-4971-984b-8f1f499fc41d (da71c617-e25a-4971-984b-8f1f499fc41d): created successfully Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c521d833-f2f4-4c33-8620-ea0872b1fef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Flow 'volume_create_manager' (c99a1ec1-3081-4bf7-9c7e-065718ceece7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:40 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d95b0bd1-8555-4040-9e39-e0a328d2f0c4 tempest-VolumesListTestJSON-1061605090 None] Created volume successfully. Jul 05 19:42:40 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 Jul 05 19:42:40 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:41 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137" returned: 0 in 1.056s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:41 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137 Jul 05 19:42:41 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:41 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:41 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce7c0b6b-9f16-46a4-8748-b95abfdec137" returned: 0 in 0.820s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-a0187e65-5d5f-4139-8014-eca0632a9314 req-12825f00-9a2b-4ced-add5-b4ec959e1e2d tempest-AttachVolumeTestJSON-368282853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984" returned: 0 in 1.130s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-a0187e65-5d5f-4139-8014-eca0632a9314 req-12825f00-9a2b-4ced-add5-b4ec959e1e2d tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.170s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-ce7c0b6b-9f16-46a4-8748-b95abfdec137" released by "delete_volume" :: held 1.955s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-a0187e65-5d5f-4139-8014-eca0632a9314 req-12825f00-9a2b-4ced-add5-b4ec959e1e2d tempest-AttachVolumeTestJSON-368282853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-fc17aba3-7539-4622-b412-e83189953984', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca1f324f-993f-4902-b6ab-89b3a24ffcbf', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:42:41 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Created reservations ['c299323c-fc05-4000-8196-8311f9c2c268', '7bee46b5-2465-4fc0-9e67-b5521046d352', '30baad4b-d2cd-43cf-9310-86f78a48e586', '7cb2d62d-b0f5-43dc-b2ee-9a8ee437138c'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:42:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-a0187e65-5d5f-4139-8014-eca0632a9314 req-12825f00-9a2b-4ced-add5-b4ec959e1e2d tempest-AttachVolumeTestJSON-368282853 None] attachment_update completed successfully. Jul 05 19:42:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:42 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:42:42 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:42 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.736s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:42 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:42:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Deleted volume successfully. Jul 05 19:42:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8751cd53-89cc-4297-a6d0-73503d9f3fbe tempest-VolumesGetTest-860026711 None] Lock "cinder-ce7c0b6b-9f16-46a4-8748-b95abfdec137-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-a4f17ece-a054-4ac7-8a04-a4b106c9e68a-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Lock "cinder-a4f17ece-a054-4ac7-8a04-a4b106c9e68a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-quobyte-a4f17ece-a054-4ac7-8a04-a4b106c9e68a" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-a4f17ece-a054-4ac7-8a04-a4b106c9e68a" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[39804ee1-0de5-4fce-a3f7-add8a0a6f6eb]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "cinder-da71c617-e25a-4971-984b-8f1f499fc41d-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:43 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a Jul 05 19:42:43 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-da71c617-e25a-4971-984b-8f1f499fc41d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "cinder-quobyte-da71c617-e25a-4971-984b-8f1f499fc41d" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-quobyte-da71c617-e25a-4971-984b-8f1f499fc41d" acquired by "delete_volume" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3603042c-fb5b-4b71-af3c-dfeb28a204a0]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:43 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d Jul 05 19:42:43 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:44 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a" returned: 0 in 0.825s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:44 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a Jul 05 19:42:44 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:44 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d" returned: 0 in 0.872s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:44 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d Jul 05 19:42:44 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:44 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a4f17ece-a054-4ac7-8a04-a4b106c9e68a" returned: 0 in 0.689s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-a4f17ece-a054-4ac7-8a04-a4b106c9e68a" released by "delete_volume" :: held 1.576s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:44 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Created reservations ['b6bdafdb-16cd-411e-a8a6-d495f3a613c6', '303eb667-8256-4b02-bd18-924a8d10ab9c', '22755d00-d283-4e7a-a448-97cc2bb37fb3', '661f153f-21ae-4335-9741-ee472f42f89d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:45 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:42:45 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:45 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-da71c617-e25a-4971-984b-8f1f499fc41d" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-quobyte-da71c617-e25a-4971-984b-8f1f499fc41d" released by "delete_volume" :: held 1.620s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Created reservations ['2f40ddbc-4bd3-4582-8ad8-276e41c810ca', 'a3936fb4-9c06-4ba6-b439-c8606bb5e895', '0d45db1a-9650-4db0-80c4-78845638d773', 'e248afdc-0653-4161-9684-114bdbfa5111'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:45 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:42:45 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:45 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.778s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:42:45 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Deleted volume successfully. Jul 05 19:42:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a5b4b15c-7fab-449c-b2ad-a46b31052c5e tempest-VolumesGetTest-860026711 None] Lock "cinder-a4f17ece-a054-4ac7-8a04-a4b106c9e68a-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "cinder-2374c145-c85e-4358-85f3-0a5fb7a0a3a3-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-2374c145-c85e-4358-85f3-0a5fb7a0a3a3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "cinder-quobyte-2374c145-c85e-4358-85f3-0a5fb7a0a3a3" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-quobyte-2374c145-c85e-4358-85f3-0a5fb7a0a3a3" acquired by "delete_volume" :: waited 0.047s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7c3183-93a3-4c22-8f65-22df5d976ed3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:46 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 Jul 05 19:42:46 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (2ec8c826-6eb1-4a2a-94a5-2866589afe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fc5899-c21a-48c6-9c77-6ab1be213db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fc5899-c21a-48c6-9c77-6ab1be213db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-348437105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1a5961-122a-4675-8242-1d33749ac4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:46Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d813c5-dc3c-45b5-945b-9baf2521f9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d813c5-dc3c-45b5-945b-9baf2521f9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adb949c-0da9-4a94-8ec2-bfb70318b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adb949c-0da9-4a94-8ec2-bfb70318b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1a5961-122a-4675-8242-1d33749ac4b3', 'volume_name': 'volume-9f1a5961-122a-4675-8242-1d33749ac4b3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142a7514-a419-4f53-922b-4db400b00596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142a7514-a419-4f53-922b-4db400b00596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62eae1f-7891-43b7-9186-518dbd963d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:46 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Volume 9f1a5961-122a-4675-8242-1d33749ac4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1a5961-122a-4675-8242-1d33749ac4b3', 'volume_size': 1} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-348437105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1a5961-122a-4675-8242-1d33749ac4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:46Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Creating volume 9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:42:46 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:46 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 1073741824 Jul 05 19:42:46 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:46 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.623s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:42:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Deleted volume successfully. Jul 05 19:42:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fccca5a9-52d9-40de-b9c0-489d79dce488 tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-da71c617-e25a-4971-984b-8f1f499fc41d-delete_volume" released by "delete_volume" :: held 3.496s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:47 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3" returned: 0 in 1.049s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:47 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3 Jul 05 19:42:47 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:47 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 1073741824" returned: 0 in 0.938s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:47 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 Jul 05 19:42:47 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:48 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2374c145-c85e-4358-85f3-0a5fb7a0a3a3" returned: 0 in 0.723s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-quobyte-2374c145-c85e-4358-85f3-0a5fb7a0a3a3" released by "delete_volume" :: held 1.859s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Created reservations ['b2164815-2ffc-48e6-9cd3-1960821157aa', 'f811a763-bb2f-45f5-82b7-f3f6a8be1e23', '5d7c84c4-6e67-4eda-aa3f-fa7f5e5f73fd', 'f94d83a4-3bdf-4b47-a75c-43617f06d804'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:48 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:42:48 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-c31f8b07-9af4-4557-a18b-76105d6460d9 req-54b77587-7b68-4e84-9725-a0deee93d102 tempest-AttachVolumeTestJSON-368282853 None] Terminate volume connection completed successfully. Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-c31f8b07-9af4-4557-a18b-76105d6460d9 req-54b77587-7b68-4e84-9725-a0deee93d102 tempest-AttachVolumeTestJSON-368282853 None] Deleting attachment fe196e59-a8f5-476c-b01a-0dcc05bcd0a4. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "cinder-8deef730-0168-4574-b090-77de61cb0fd0-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-8deef730-0168-4574-b090-77de61cb0fd0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "cinder-quobyte-8deef730-0168-4574-b090-77de61cb0fd0" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-quobyte-8deef730-0168-4574-b090-77de61cb0fd0" acquired by "delete_volume" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87d9913-62e9-4d2d-8d29-f00c99dce902]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:48 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3" returned: 0 in 0.966s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62eae1f-7891-43b7-9186-518dbd963d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1a5961-122a-4675-8242-1d33749ac4b3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562ce8a1-a570-4f49-a311-c54b8758c4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:48 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Volume volume-9f1a5961-122a-4675-8242-1d33749ac4b3 (9f1a5961-122a-4675-8242-1d33749ac4b3): created successfully Jul 05 19:42:48 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0 Jul 05 19:42:48 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562ce8a1-a570-4f49-a311-c54b8758c4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (2ec8c826-6eb1-4a2a-94a5-2866589afe75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-92f107a7-dfbf-4b63-9c4c-cef8342c4808 tempest-VolumesGetTest-860026711 None] Created volume successfully. Jul 05 19:42:49 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.873s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:49 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:42:49 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Deleted volume successfully. Jul 05 19:42:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-42253c95-0cbf-4114-b54e-49561c80c52d tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-2374c145-c85e-4358-85f3-0a5fb7a0a3a3-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:49 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0" returned: 0 in 0.842s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:49 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0 Jul 05 19:42:49 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:50 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8deef730-0168-4574-b090-77de61cb0fd0" returned: 0 in 0.709s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-quobyte-8deef730-0168-4574-b090-77de61cb0fd0" released by "delete_volume" :: held 1.614s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Created reservations ['4856e838-f1fa-40d6-8aed-2a3507ec1e84', '04f6da26-41f4-4a16-b211-b155ce49b74e', '07657443-ea34-417b-8fdb-e48f0d503f99', 'e2b58d48-c0ce-40d2-af12-727d695789cc'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:50 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:42:50 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (c15ca271-290b-4de4-8453-7eb9a934491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be04564d-d687-4435-bf2f-070db974a6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be04564d-d687-4435-bf2f-070db974a6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1537236650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01792b1d-5023-45e0-9bd6-d3f663ee9f4a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9f1a5961-122a-4675-8242-1d33749ac4b3,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:50Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f7cff3-c59b-4a3f-9bba-6332fb490b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f7cff3-c59b-4a3f-9bba-6332fb490b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ceb6fd4-3328-447c-aa57-6ccddd95cbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ceb6fd4-3328-447c-aa57-6ccddd95cbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '01792b1d-5023-45e0-9bd6-d3f663ee9f4a', 'volume_name': 'volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a', 'volume_size': 1, 'source_volid': '9f1a5961-122a-4675-8242-1d33749ac4b3', 'source_volstatus': 'available'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d2e649-e3bb-4a16-9ec3-2b0e2d19f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d2e649-e3bb-4a16-9ec3-2b0e2d19f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8ee2cd-be9f-471c-9b7e-3d9f72231fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:50 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Volume 01792b1d-5023-45e0-9bd6-d3f663ee9f4a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a', 'volume_size': 1, 'source_volid': '9f1a5961-122a-4675-8242-1d33749ac4b3', 'source_volstatus': 'available'} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:50 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Cloning volume 9f1a5961-122a-4675-8242-1d33749ac4b3 to volume 01792b1d-5023-45e0-9bd6-d3f663ee9f4a Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Creating offline snapshot 6db5747c-4bd8-4c83-8883-7f8e0aebeb0a of volume 9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e44d14-48ad-494f-adb6-dba1ba0d76a3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:50 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 Jul 05 19:42:50 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:50 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-173f25da-3c68-4c87-a14a-7569e3cb1235 req-08d5c4e5-1220-4829-82ce-3c141e716d77 tempest-AttachVolumeTestJSON-368282853 None] Terminate volume connection completed successfully. Jul 05 19:42:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-173f25da-3c68-4c87-a14a-7569e3cb1235 req-08d5c4e5-1220-4829-82ce-3c141e716d77 tempest-AttachVolumeTestJSON-368282853 None] Deleting attachment ca1f324f-993f-4902-b6ab-89b3a24ffcbf. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:42:51 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.798s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:51 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:42:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Deleted volume successfully. Jul 05 19:42:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-53ac9ebf-e8c4-4ff5-a3f1-208adb20882b tempest-VolumesListTestJSON-1061605090 None] Lock "cinder-8deef730-0168-4574-b090-77de61cb0fd0-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:42:51 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3" returned: 0 in 1.133s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:51 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a 1G Jul 05 19:42:51 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:52 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a 1G" returned: 0 in 1.103s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f1a5961-122a-4675-8242-1d33749ac4b3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:52 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f1a5961-122a-4675-8242-1d33749ac4b3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a Jul 05 19:42:52 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:53 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f1a5961-122a-4675-8242-1d33749ac4b3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a" returned: 0 in 0.780s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:53 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a is being set with open permissions: ugo+rw Jul 05 19:42:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:53 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a Jul 05 19:42:53 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:42:54 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Flow 'volume_create_manager' (47d07455-946e-4240-ae87-b02dc0c31f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68b7a4d-bfc2-480b-881e-47f5d3fa4f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a" returned: 0 in 0.707s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68b7a4d-bfc2-480b-881e-47f5d3fa4f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-456725509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88846f0b-1eae-401d-88b6-30ccdfa1ebc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cad4c5ac8534f59a8e04e7ad409b5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:54Z,use_quota=True,user_id='2f6365d913f0442cb0395419047f4c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6918f85d-6a7d-48a4-ad75-2daa3158ccb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6918f85d-6a7d-48a4-ad75-2daa3158ccb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35178a99-f064-4c70-bef0-df1b5d46dba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35178a99-f064-4c70-bef0-df1b5d46dba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88846f0b-1eae-401d-88b6-30ccdfa1ebc1', 'volume_name': 'volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69834fa0-15e8-42df-8637-413cd34514f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69834fa0-15e8-42df-8637-413cd34514f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4243e9-fdbd-402f-af83-08aba0f358f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:42:54 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Volume 88846f0b-1eae-401d-88b6-30ccdfa1ebc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1', 'volume_size': 1} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:54 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.info Jul 05 19:42:54 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:54 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.info" returned: 0 in 0.659s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:54 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.info is being set with open permissions: ugo+rw Jul 05 19:42:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:55 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.info Jul 05 19:42:55 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:55 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.info" returned: 0 in 0.799s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-quobyte-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] snapshot: 6db5747c-4bd8-4c83-8883-7f8e0aebeb0a, volume: 01792b1d-5023-45e0-9bd6-d3f663ee9f4a, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa160151-ed9d-49fc-bcb6-064d20910d6d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:56 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a Jul 05 19:42:56 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:56 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a" returned: 0 in 0.836s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f1a5961-122a-4675-8242-1d33749ac4b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:42:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:42:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:42:56 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[930c17cf-b2a5-42c7-9078-3d0eabd24e66]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:42:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:56 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 Jul 05 19:42:56 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:57 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 05 19:42:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3" returned: 0 in 0.833s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:42:57 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:42:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:42:57 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a Jul 05 19:42:57 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:42:59 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=112,cinder:DELETE=8,cinder:SELECT=105,cinder:INSERT=26 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:42:59 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=97,cinder:UPDATE=109,cinder:INSERT=24,cinder:DELETE=11 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:43:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "cinder-fc17aba3-7539-4622-b412-e83189953984-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" returned: 0 in 6.224s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-fc17aba3-7539-4622-b412-e83189953984-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:03 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[147047ca-8397-4a55-9889-da70ca581068]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "cinder-quobyte-fc17aba3-7539-4622-b412-e83189953984" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-quobyte-fc17aba3-7539-4622-b412-e83189953984" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:03 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29844b2-6ab2-4742-aba0-dc093643caaa]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:03 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 Jul 05 19:43:03 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:04 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 Jul 05 19:43:04 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:04 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-95eb6dac-36f9-4c54-b5bc-0946596743d6 req-66182ad5-c432-40a0-aa2b-bd279d9838b5 tempest-ServerActionsTestOtherA-1830110092 None] Terminate volume connection completed successfully. Jul 05 19:43:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95eb6dac-36f9-4c54-b5bc-0946596743d6 req-66182ad5-c432-40a0-aa2b-bd279d9838b5 tempest-ServerActionsTestOtherA-1830110092 None] Deleting attachment c3636b2d-17e4-4af0-a56c-a56b3ba00890. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:43:04 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984" returned: 0 in 0.833s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:04 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984 Jul 05 19:43:04 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:04 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3" returned: 0 in 0.999s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:04 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:43:04 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Converted 1024.00 MB image at 164.49 MB/s Jul 05 19:43:04 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a is being set with open permissions: ugo+rw Jul 05 19:43:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:04 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a Jul 05 19:43:04 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:05 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc17aba3-7539-4622-b412-e83189953984" returned: 0 in 0.695s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-quobyte-fc17aba3-7539-4622-b412-e83189953984" released by "delete_volume" :: held 1.575s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:05 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" returned: 0 in 0.678s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" released by "_copy_volume_from_snapshot" :: held 9.664s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Created reservations ['bfa1391b-a427-4bf2-a2f4-aebc38a21d20', '2809cccd-3c82-4028-bd99-db27dc90ac65', '04ed00f3-8f8f-4040-b422-41829d7e3885', '59b20876-0992-4e17-90d0-84205bd67f2f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-quobyte-6db5747c-4bd8-4c83-8883-7f8e0aebeb0a" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-6db5747c-4bd8-4c83-8883-7f8e0aebeb0a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Deleting offline snapshot 6db5747c-4bd8-4c83-8883-7f8e0aebeb0a of volume 9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] snapshot_file for this snap is: volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0594bf7-3453-4808-9ba1-dfc28bd5300e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:05 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:05 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:05 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a Jul 05 19:43:05 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "cinder-8712d616-3f54-47a6-905b-a2bb45fcc1b7-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-8712d616-3f54-47a6-905b-a2bb45fcc1b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "cinder-quobyte-8712d616-3f54-47a6-905b-a2bb45fcc1b7" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-quobyte-8712d616-3f54-47a6-905b-a2bb45fcc1b7" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab4c213-7b92-47c8-896f-187f309b7a5e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:06 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 Jul 05 19:43:06 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:06 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.739s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:06 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Deleted volume successfully. Jul 05 19:43:06 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a" returned: 0 in 0.820s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f1a5961-122a-4675-8242-1d33749ac4b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-01bc84ec-8595-4b75-9200-f5b1a79ec8b5 tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-fc17aba3-7539-4622-b412-e83189953984-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e12cc7-0bcb-463e-8c42-1d0f7ed7a01a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:06 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 Jul 05 19:43:06 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:07 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7" returned: 0 in 0.913s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:07 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7 Jul 05 19:43:07 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:07 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3" returned: 0 in 0.880s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:07 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a Jul 05 19:43:07 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:07 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8712d616-3f54-47a6-905b-a2bb45fcc1b7" returned: 0 in 0.725s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-quobyte-8712d616-3f54-47a6-905b-a2bb45fcc1b7" released by "delete_volume" :: held 1.703s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:07 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Created reservations ['07231471-e2c0-4c96-a0c6-3d45a436261a', 'd717a28f-749d-4a8c-b508-d0450ea956ad', '34b1ffa1-09cf-4be9-a574-ec4984ab9baa', '312e7459-c321-4d13-90fd-0e44ea3ad3ca'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:08 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:08 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "cinder-989ed373-d23e-4bdc-b316-9f6f5bf69d2b-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-989ed373-d23e-4bdc-b316-9f6f5bf69d2b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:08 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "cinder-quobyte-989ed373-d23e-4bdc-b316-9f6f5bf69d2b" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a" returned: 0 in 1.316s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-quobyte-989ed373-d23e-4bdc-b316-9f6f5bf69d2b" acquired by "delete_volume" :: waited 0.041s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:08 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a Jul 05 19:43:08 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6be0343-8f35-481b-8c01-240394583b19]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:09 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b Jul 05 19:43:09 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:09 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.199s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:09 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Deleted volume successfully. Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9ff58795-521d-4764-87d2-6251b415482f tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-8712d616-3f54-47a6-905b-a2bb45fcc1b7-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:09 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3.6db5747c-4bd8-4c83-8883-7f8e0aebeb0a" returned: 0 in 0.986s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-6db5747c-4bd8-4c83-8883-7f8e0aebeb0a" released by "_delete_snapshot" :: held 4.123s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.239s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.420s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-456725509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88846f0b-1eae-401d-88b6-30ccdfa1ebc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cad4c5ac8534f59a8e04e7ad409b5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:42:54Z,use_quota=True,user_id='2f6365d913f0442cb0395419047f4c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Creating volume 88846f0b-1eae-401d-88b6-30ccdfa1ebc1 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:43:09 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8ee2cd-be9f-471c-9b7e-3d9f72231fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a', 'volume_size': 1, 'source_volid': '9f1a5961-122a-4675-8242-1d33749ac4b3', 'source_volstatus': 'available'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:09 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 1073741824 Jul 05 19:43:09 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02440e21-7ffe-4aec-9b9e-9901c1b8fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:09 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Volume volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a (01792b1d-5023-45e0-9bd6-d3f663ee9f4a): created successfully Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02440e21-7ffe-4aec-9b9e-9901c1b8fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (c15ca271-290b-4de4-8453-7eb9a934491c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:43:09 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ec275a47-0335-4b1f-a9cb-315c4fb02e54 tempest-VolumesGetTest-860026711 None] Created volume successfully. Jul 05 19:43:09 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b" returned: 0 in 1.107s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:09 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b Jul 05 19:43:09 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:10 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-989ed373-d23e-4bdc-b316-9f6f5bf69d2b" returned: 0 in 0.814s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-quobyte-989ed373-d23e-4bdc-b316-9f6f5bf69d2b" released by "delete_volume" :: held 2.051s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:10 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Created reservations ['317bff58-2381-45f5-acce-70220c402520', '43d4c9f7-56cb-4571-a211-8cad03cbaa37', '8b59f3d2-630d-41cb-a91f-552b0fa07349', '2b7f9cd7-409f-45d3-89d5-d4fc54c790dd'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:10 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 1073741824" returned: 0 in 1.182s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:43:11 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 Jul 05 19:43:11 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (c46985ea-1d52-405d-9c5c-5a76d4b1dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdba20c1-b58d-4189-977e-43e97ba7cbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdba20c1-b58d-4189-977e-43e97ba7cbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:43:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1703517734',display_name='tempest-VolumesGetTest-Volume-197627499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c2dcc-8c52-472c-b4b7-e5487a59f836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:43:11Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3e3858-2a8e-4d2f-ba52-c45b48896aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3e3858-2a8e-4d2f-ba52-c45b48896aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7ef0d1-26cf-45a8-8f54-952ddae586d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7ef0d1-26cf-45a8-8f54-952ddae586d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122c2dcc-8c52-472c-b4b7-e5487a59f836', 'volume_name': 'volume-122c2dcc-8c52-472c-b4b7-e5487a59f836', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c0fd1c-3eda-4f26-896a-8571587d9262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c0fd1c-3eda-4f26-896a-8571587d9262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfec768d-3f53-4960-8b49-ea446d4d29a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:11 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Volume 122c2dcc-8c52-472c-b4b7-e5487a59f836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122c2dcc-8c52-472c-b4b7-e5487a59f836', 'volume_size': 1} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:11 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:11 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:11 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1" returned: 0 in 0.662s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:43:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1703517734',display_name='tempest-VolumesGetTest-Volume-197627499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c2dcc-8c52-472c-b4b7-e5487a59f836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:43:11Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Creating volume 122c2dcc-8c52-472c-b4b7-e5487a59f836 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:43:11 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4243e9-fdbd-402f-af83-08aba0f358f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb9397d-40d2-4e84-b5f4-76654351fe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:11 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 1073741824 Jul 05 19:43:11 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:11 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Volume volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 (88846f0b-1eae-401d-88b6-30ccdfa1ebc1): created successfully Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb9397d-40d2-4e84-b5f4-76654351fe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Flow 'volume_create_manager' (47d07455-946e-4240-ae87-b02dc0c31f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:43:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2cabff60-6795-4d70-8492-2e1bded8bea6 tempest-VolumesNegativeTest-1145076036 None] Created volume successfully. Jul 05 19:43:11 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.755s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Deleted volume successfully. Jul 05 19:43:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6124c0cd-2f32-4daf-834e-7fa64b5822a8 tempest-AttachVolumeTestJSON-368282853 None] Lock "cinder-989ed373-d23e-4bdc-b316-9f6f5bf69d2b-delete_volume" released by "delete_volume" :: held 3.381s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:12 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 1073741824" returned: 0 in 0.924s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:12 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 Jul 05 19:43:12 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:13 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836" returned: 0 in 0.816s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:43:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfec768d-3f53-4960-8b49-ea446d4d29a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122c2dcc-8c52-472c-b4b7-e5487a59f836', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dda18b-f051-4881-8ade-e00209083816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:13 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Volume volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 (122c2dcc-8c52-472c-b4b7-e5487a59f836): created successfully Jul 05 19:43:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dda18b-f051-4881-8ade-e00209083816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (c46985ea-1d52-405d-9c5c-5a76d4b1dd80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:43:13 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-03e9e8e0-4ff8-41c5-beff-590a206205e7 tempest-VolumesGetTest-860026711 None] Created volume successfully. Jul 05 19:43:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-122c2dcc-8c52-472c-b4b7-e5487a59f836-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Lock "cinder-122c2dcc-8c52-472c-b4b7-e5487a59f836-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-quobyte-122c2dcc-8c52-472c-b4b7-e5487a59f836" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-122c2dcc-8c52-472c-b4b7-e5487a59f836" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:14 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[857ca05c-e5d5-4385-9815-4ad83804fc56]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:14 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 Jul 05 19:43:14 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:15 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836" returned: 0 in 0.842s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:15 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836 Jul 05 19:43:15 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Acquiring lock "cinder-a23f5904-0939-447d-beea-37126c482f71-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Lock "cinder-a23f5904-0939-447d-beea-37126c482f71-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Acquiring lock "cinder-quobyte-a23f5904-0939-447d-beea-37126c482f71" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Lock "cinder-quobyte-a23f5904-0939-447d-beea-37126c482f71" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9751aca6-7c56-45a8-8688-2bbdbd821292]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:15 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 Jul 05 19:43:15 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:16 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-122c2dcc-8c52-472c-b4b7-e5487a59f836" returned: 0 in 0.774s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-122c2dcc-8c52-472c-b4b7-e5487a59f836" released by "delete_volume" :: held 1.677s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Created reservations ['8534fe85-91c1-4087-8467-0be8f0f77417', 'b95e1934-554b-428c-a5db-bf736c7f3265', '8862ad6c-17a2-40a4-8c48-76cb4ea29334', 'abd42c21-57ea-451e-8273-cf38e316bfa7'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:16 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:16 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:16 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:16 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71" returned: 0 in 0.964s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:16 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:16 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71 Jul 05 19:43:16 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-01792b1d-5023-45e0-9bd6-d3f663ee9f4a-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Lock "cinder-01792b1d-5023-45e0-9bd6-d3f663ee9f4a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-quobyte-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5268d182-9916-4239-af49-42f2fc74fa62]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:17 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.070s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:43:17 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a Jul 05 19:43:17 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:17 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.147s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Deleted volume successfully. Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fda20dd0-f07f-4bbe-bf8c-3becb776d0d8 tempest-VolumesGetTest-860026711 None] Lock "cinder-122c2dcc-8c52-472c-b4b7-e5487a59f836-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:17 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a23f5904-0939-447d-beea-37126c482f71" returned: 0 in 1.060s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Lock "cinder-quobyte-a23f5904-0939-447d-beea-37126c482f71" released by "delete_volume" :: held 2.101s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Created reservations ['ebc40e15-4018-4d24-8b96-98701588bb3d', 'ec639029-dee4-4b35-8438-72e0c838b7a9', 'aca8250a-f352-427e-ae3e-4fd0e71671f3', 'd5336d08-ecf1-4140-8fdb-87aa322e10ae'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:17 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:17 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:18 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" returned: 0 in 1.024s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:18 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a Jul 05 19:43:18 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:18 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.765s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:18 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:18 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Deleted volume successfully. Jul 05 19:43:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1c9fdcc1-abc9-430a-8614-5763b6160a6d tempest-ServerActionsTestOtherA-1830110092 None] Lock "cinder-a23f5904-0939-447d-beea-37126c482f71-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:19 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" returned: 0 in 0.939s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-01792b1d-5023-45e0-9bd6-d3f663ee9f4a" released by "delete_volume" :: held 2.040s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:19 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Created reservations ['2a91774f-a147-4518-b26a-1272423d19f5', '2c910f73-b51e-4420-9b75-4c810b23fce2', '3b8a9728-48f7-42b1-96d0-3d81933cd7b4', '90931343-f30b-4f6a-b6f3-ee51f788f951'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:19 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:19 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:20 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.776s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:20 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Deleted volume successfully. Jul 05 19:43:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e2b705b7-f2b9-439e-a725-4ad0de98dfd3 tempest-VolumesGetTest-860026711 None] Lock "cinder-01792b1d-5023-45e0-9bd6-d3f663ee9f4a-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-9f1a5961-122a-4675-8242-1d33749ac4b3-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Lock "cinder-9f1a5961-122a-4675-8242-1d33749ac4b3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-quobyte-9f1a5961-122a-4675-8242-1d33749ac4b3" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-9f1a5961-122a-4675-8242-1d33749ac4b3" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:20 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e95dc-2289-49b9-bd22-8960bd367c62]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:20 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 Jul 05 19:43:20 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3" returned: 0 in 1.166s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:21 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:21 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3 Jul 05 19:43:21 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:22 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f1a5961-122a-4675-8242-1d33749ac4b3" returned: 0 in 0.808s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-9f1a5961-122a-4675-8242-1d33749ac4b3" released by "delete_volume" :: held 2.048s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:22 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Created reservations ['d2c83a6f-7b38-47b4-b296-7faf05e9b9d7', 'c72f4214-a3db-4fe4-b2bf-42f22cdbee2a', '87ff8e94-614d-44b6-b150-fdfec34c892e', 'e53784da-d2c3-4fe8-bbf7-8ed4dfdf8a80'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:22 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:22 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:23 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.881s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:23 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Deleted volume successfully. Jul 05 19:43:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6ab58c97-9d5c-4c7a-a5f7-ef4fe0cfad38 tempest-VolumesGetTest-860026711 None] Lock "cinder-9f1a5961-122a-4675-8242-1d33749ac4b3-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:24 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:43:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (7d0629d3-4bc7-4139-bc80-3a467f529ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:43:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf263d2-ecdf-49d7-bf49-c4a1d58da542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf263d2-ecdf-49d7-bf49-c4a1d58da542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1778816490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74247ce3-2047-4b93-bd29-8ccce378c111,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:43:25Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d062e5-07b0-4437-ada4-4cbc155de74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d062e5-07b0-4437-ada4-4cbc155de74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2792ed-82ca-48e9-91c9-35b2b53f35a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:24 devstack cinder-volume[86389]: DEBUG cinder.image.glance [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Creating Keystone auth plugin from conf {{(pid=86389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 19:43:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2792ed-82ca-48e9-91c9-35b2b53f35a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74247ce3-2047-4b93-bd29-8ccce378c111', 'volume_name': 'volume-74247ce3-2047-4b93-bd29-8ccce378c111', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d7a9ab-c8e6-433e-b7e3-707a6d005850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d7a9ab-c8e6-433e-b7e3-707a6d005850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a062180-c90d-4c0e-841e-7727235c3bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:25 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Volume 74247ce3-2047-4b93-bd29-8ccce378c111: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74247ce3-2047-4b93-bd29-8ccce378c111', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 19:43:25 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Trying to clone 74247ce3-2047-4b93-bd29-8ccce378c111 from image aa12a165-b970-4e97-bb87-7bd652f13413 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]). {{(pid=86389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 19:43:25 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 19:43:25 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Image download 20.69 MB at 20.69 MB/s Jul 05 19:43:25 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0fb943-eff1-4b88-ae56-4c51f107718f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:25 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD Jul 05 19:43:25 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:26 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD" returned: 0 in 1.166s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:26 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Temporary image aa12a165-b970-4e97-bb87-7bd652f13413 is fetched for user 35d183db6a0640e18ae935cbadd1e612. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 19:43:26 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2f78b6-15d9-4b8a-ab66-6beaacbefe1d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:27 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD Jul 05 19:43:27 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:27 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD" returned: 0 in 0.994s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1778816490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74247ce3-2047-4b93-bd29-8ccce378c111,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:43:25Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Creating volume 74247ce3-2047-4b93-bd29-8ccce378c111 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:43:27 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:43:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:27 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 1073741824 Jul 05 19:43:27 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:29 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 1073741824" returned: 0 in 1.317s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:29 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 Jul 05 19:43:29 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:30 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111" returned: 0 in 1.173s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] <== create_volume: return (2569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:43:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.581s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:30 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Attempting download of aa12a165-b970-4e97-bb87-7bd652f13413 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}])) to volume 74247ce3-2047-4b93-bd29-8ccce378c111. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 19:43:30 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256ae2a-c151-4b39-9a69-7b333358a6af]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_r6i2pnsp {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:30 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_r6i2pnsp Jul 05 19:43:30 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:31 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_r6i2pnsp" returned: 0 in 1.253s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_r6i2pnsp {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:32 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_r6i2pnsp Jul 05 19:43:32 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:32 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_r6i2pnsp" returned: 1 in 1.150s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_r6i2pnsp' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:43:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[180c94be-2261-4712-9e3f-5af4385806ef]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:33 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD Jul 05 19:43:33 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:34 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD" returned: 0 in 1.228s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:34 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] aa12a165-b970-4e97-bb87-7bd652f13413 was qcow2, converting to raw {{(pid=86389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 19:43:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:34 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 Jul 05 19:43:34 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:37 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111" returned: 0 in 3.136s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:37 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_2g2v4feodevstack@QuobyteHD, size 112.00 MB, duration 3.14 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:43:37 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Converted 112.00 MB image at 35.67 MB/s Jul 05 19:43:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:37 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 1G Jul 05 19:43:37 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:38 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 1G" returned: 0 in 0.873s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:38 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[476f6003-660d-4df1-b491-74527dfb33b0]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:38 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 Jul 05 19:43:38 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:39 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=44,cinder:INSERT=15,cinder:UPDATE=63,cinder:DELETE=4 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:43:39 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111" returned: 0 in 1.217s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:39 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 Jul 05 19:43:39 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=72,cinder:SELECT=42,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:43:40 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111" returned: 1 in 1.136s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Downloaded image aa12a165-b970-4e97-bb87-7bd652f13413 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}])) to volume 74247ce3-2047-4b93-bd29-8ccce378c111 successfully. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Temporary image aa12a165-b970-4e97-bb87-7bd652f13413 for user 35d183db6a0640e18ae935cbadd1e612 is deleted. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Marking volume 74247ce3-2047-4b93-bd29-8ccce378c111 as bootable. {{(pid=86389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Copying metadata from image aa12a165-b970-4e97-bb87-7bd652f13413 to 74247ce3-2047-4b93-bd29-8ccce378c111. {{(pid=86389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Creating volume glance metadata for volume 74247ce3-2047-4b93-bd29-8ccce378c111 backed by image aa12a165-b970-4e97-bb87-7bd652f13413 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a062180-c90d-4c0e-841e-7727235c3bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74247ce3-2047-4b93-bd29-8ccce378c111', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e13ad15-ece6-40a8-b3c9-3a478a0278bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:40 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Volume volume-74247ce3-2047-4b93-bd29-8ccce378c111 (74247ce3-2047-4b93-bd29-8ccce378c111): created successfully Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e13ad15-ece6-40a8-b3c9-3a478a0278bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (7d0629d3-4bc7-4139-bc80-3a467f529ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:43:40 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b9f60576-9b95-472b-9dd3-05c7bdad9ba1 tempest-VolumesGetTest-860026711 None] Created volume successfully. Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (716118c8-0ae6-44fc-9696-b11a5f006e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c782c9-d1a6-4d1d-8248-dc4687f1f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c782c9-d1a6-4d1d-8248-dc4687f1f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:43:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1720324114',display_name='tempest-VolumesGetTest-Volume-2118691291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc28c330-31d5-4164-b2fa-dcab47851ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:43:42Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e793716a-0aa1-43c5-892f-28f44d45f6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e793716a-0aa1-43c5-892f-28f44d45f6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55aa311b-e7f4-4bc7-8332-c6e3251b32a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55aa311b-e7f4-4bc7-8332-c6e3251b32a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc28c330-31d5-4164-b2fa-dcab47851ed3', 'volume_name': 'volume-dc28c330-31d5-4164-b2fa-dcab47851ed3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae801271-f425-4e27-9c74-f00601941095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae801271-f425-4e27-9c74-f00601941095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa4a2c7-296f-4957-9222-a4a1b301cd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:42 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Volume dc28c330-31d5-4164-b2fa-dcab47851ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc28c330-31d5-4164-b2fa-dcab47851ed3', 'volume_size': 1} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:43:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1720324114',display_name='tempest-VolumesGetTest-Volume-2118691291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc28c330-31d5-4164-b2fa-dcab47851ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0f3d1a06f4309911d55e684628459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:43:42Z,use_quota=True,user_id='35d183db6a0640e18ae935cbadd1e612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Creating volume dc28c330-31d5-4164-b2fa-dcab47851ed3 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:43:42 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:43:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:42 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 1073741824 Jul 05 19:43:42 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:43 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 1073741824" returned: 0 in 0.949s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:43 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 Jul 05 19:43:43 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:43 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3" returned: 0 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:43:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa4a2c7-296f-4957-9222-a4a1b301cd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc28c330-31d5-4164-b2fa-dcab47851ed3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e197f37-1ec5-4c90-a7cb-cad296e2e82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:43:44 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Volume volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 (dc28c330-31d5-4164-b2fa-dcab47851ed3): created successfully Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e197f37-1ec5-4c90-a7cb-cad296e2e82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Flow 'volume_create_manager' (716118c8-0ae6-44fc-9696-b11a5f006e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:43:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-23d38e1b-9c4e-4174-afa4-f0a4e39073c0 tempest-VolumesGetTest-860026711 None] Created volume successfully. Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-dc28c330-31d5-4164-b2fa-dcab47851ed3-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Lock "cinder-dc28c330-31d5-4164-b2fa-dcab47851ed3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-quobyte-dc28c330-31d5-4164-b2fa-dcab47851ed3" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-dc28c330-31d5-4164-b2fa-dcab47851ed3" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd30ca5-0f76-4059-ae82-8745f25ffef7]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:44 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 Jul 05 19:43:44 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:45 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3" returned: 0 in 1.021s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:45 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3 Jul 05 19:43:45 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:46 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dc28c330-31d5-4164-b2fa-dcab47851ed3" returned: 0 in 1.251s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-dc28c330-31d5-4164-b2fa-dcab47851ed3" released by "delete_volume" :: held 2.332s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:46 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Created reservations ['5fbfcbe1-7e90-49a0-bfcb-1a4526be107f', '7d255ebe-054b-437f-8f91-0c331f580a0f', '0b53e9a6-fed2-4ad0-8979-efe663427153', 'd4d0bac5-3e90-4f59-b79e-8e15964d9f4c'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:47 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:47 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-74247ce3-2047-4b93-bd29-8ccce378c111-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Lock "cinder-74247ce3-2047-4b93-bd29-8ccce378c111-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Acquiring lock "cinder-quobyte-74247ce3-2047-4b93-bd29-8ccce378c111" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-74247ce3-2047-4b93-bd29-8ccce378c111" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:48 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[120c0981-d3ab-47c7-8c8e-4847e5c50c7b]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:48 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.144s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:48 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Deleted volume successfully. Jul 05 19:43:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-04a136b9-3227-4af1-adc2-d38cc3e5f2a2 tempest-VolumesGetTest-860026711 None] Lock "cinder-dc28c330-31d5-4164-b2fa-dcab47851ed3-delete_volume" released by "delete_volume" :: held 3.837s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:48 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 Jul 05 19:43:48 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:49 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111" returned: 0 in 1.110s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:49 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 Jul 05 19:43:49 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:50 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111" returned: 1 in 1.059s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:43:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:50 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111 Jul 05 19:43:50 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:51 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-74247ce3-2047-4b93-bd29-8ccce378c111" returned: 0 in 0.864s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Lock "cinder-quobyte-74247ce3-2047-4b93-bd29-8ccce378c111" released by "delete_volume" :: held 3.151s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:51 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Created reservations ['5f330da5-c4eb-4af6-b9d2-e4e3bbd8263c', 'a4e3fa85-f00b-490d-bac6-222baeb68d6f', 'b5afc84e-d82d-4979-8492-d4f218ccca68', '9ff60cd9-de08-4fa6-a8d7-6f514022239a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:51 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:51 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:52 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.065s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:52 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Acquiring lock "cinder-88846f0b-1eae-401d-88b6-30ccdfa1ebc1-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:52 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Deleted volume successfully. Jul 05 19:43:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Lock "cinder-88846f0b-1eae-401d-88b6-30ccdfa1ebc1-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-293ffb41-b46d-47d5-a255-b6f82c3c73fa tempest-VolumesGetTest-860026711 None] Lock "cinder-74247ce3-2047-4b93-bd29-8ccce378c111-delete_volume" released by "delete_volume" :: held 4.666s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Acquiring lock "cinder-quobyte-88846f0b-1eae-401d-88b6-30ccdfa1ebc1" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:43:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Lock "cinder-quobyte-88846f0b-1eae-401d-88b6-30ccdfa1ebc1" acquired by "delete_volume" :: waited 0.076s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:43:52 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[834a4d10-bf3e-4dab-bf7c-eceb903f1614]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:43:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:53 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 Jul 05 19:43:53 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:54 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1" returned: 0 in 1.127s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:54 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1 Jul 05 19:43:54 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:54 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-88846f0b-1eae-401d-88b6-30ccdfa1ebc1" returned: 0 in 0.975s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Lock "cinder-quobyte-88846f0b-1eae-401d-88b6-30ccdfa1ebc1" released by "delete_volume" :: held 2.202s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:43:55 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Created reservations ['0a8f693c-0b38-4382-8baf-ff28a87e5447', '44403cdb-dd3d-49de-b9d5-f4b1a8dfaace', '91f2b1f1-eebd-49a3-8f8a-3a03c73ee384', '9023fdfa-bb88-4d79-a774-ae90ee568b53'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:43:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:43:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:43:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:43:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:43:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:43:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:43:55 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:43:55 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:43:55 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 05 19:43:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.829s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:43:56 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:43:56 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Deleted volume successfully. Jul 05 19:43:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1ea1fdc0-5b46-447a-b529-985d8bacb054 tempest-VolumesNegativeTest-1145076036 None] Lock "cinder-88846f0b-1eae-401d-88b6-30ccdfa1ebc1-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:44:00 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Flow 'volume_create_manager' (a13c9ba0-03c2-41bb-b5af-04217bf15352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed6f8e8-31a8-4a72-8530-f41124878278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed6f8e8-31a8-4a72-8530-f41124878278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1321526783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f395296-a2f6-482a-ada5-a468cc793137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b8f2222a6de49d9a452c3b33f4a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:01Z,use_quota=True,user_id='946761061c044069a26dbc1409499344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b941cdf4-3d55-4aee-a69b-315d76235a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b941cdf4-3d55-4aee-a69b-315d76235a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc3f5af-df5d-4c20-834e-5608d12d7888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc3f5af-df5d-4c20-834e-5608d12d7888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f395296-a2f6-482a-ada5-a468cc793137', 'volume_name': 'volume-2f395296-a2f6-482a-ada5-a468cc793137', 'volume_size': 2}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e207bfe-0ad8-4d69-acba-9005d5867498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e207bfe-0ad8-4d69-acba-9005d5867498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b0c831-9296-4b35-9611-e546f6f74e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:01 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Volume 2f395296-a2f6-482a-ada5-a468cc793137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f395296-a2f6-482a-ada5-a468cc793137', 'volume_size': 2} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1321526783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f395296-a2f6-482a-ada5-a468cc793137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b8f2222a6de49d9a452c3b33f4a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:01Z,use_quota=True,user_id='946761061c044069a26dbc1409499344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Creating volume 2f395296-a2f6-482a-ada5-a468cc793137 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:44:01 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:44:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 2147483648 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:01 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 2147483648 Jul 05 19:44:01 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:02 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 2147483648" returned: 0 in 1.534s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:02 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 Jul 05 19:44:02 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:03 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137" returned: 0 in 1.080s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] <== create_volume: return (2717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:44:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.724s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:03 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b0c831-9296-4b35-9611-e546f6f74e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f395296-a2f6-482a-ada5-a468cc793137', 'volume_size': 2}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:03 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9bf91b-7304-4510-af1c-f8c928ad2980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:03 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Volume volume-2f395296-a2f6-482a-ada5-a468cc793137 (2f395296-a2f6-482a-ada5-a468cc793137): created successfully Jul 05 19:44:03 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9bf91b-7304-4510-af1c-f8c928ad2980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:03 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Flow 'volume_create_manager' (a13c9ba0-03c2-41bb-b5af-04217bf15352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:03 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6e7d23dd-5d36-49e7-8e6c-4af4ab405e3d tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Created volume successfully. Jul 05 19:44:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Creating offline snapshot 45d4728f-54ee-4d4f-b9dd-c01dab453eb3 of volume 2f395296-a2f6-482a-ada5-a468cc793137 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:44:04 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00e0d74-2d10-49e8-9c61-a9944325361f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:04 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 Jul 05 19:44:04 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:05 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137" returned: 0 in 1.089s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 2G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:05 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 2G Jul 05 19:44:05 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:07 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 2G" returned: 0 in 1.493s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f395296-a2f6-482a-ada5-a468cc793137 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:07 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f395296-a2f6-482a-ada5-a468cc793137 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 Jul 05 19:44:07 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:08 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f395296-a2f6-482a-ada5-a468cc793137 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3" returned: 0 in 1.040s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:08 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 is being set with open permissions: ugo+rw Jul 05 19:44:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:08 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 Jul 05 19:44:08 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:09 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3" returned: 0 in 0.732s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:09 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.info Jul 05 19:44:09 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:09 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.info" returned: 0 in 0.836s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:10 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.info is being set with open permissions: ugo+rw Jul 05 19:44:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:10 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.info Jul 05 19:44:10 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:11 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.info" returned: 0 in 1.266s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.580s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-055e781d-4651-4626-bf80-657e188ccf82 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Create snapshot completed successfully Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Acquiring lock "cinder-45d4728f-54ee-4d4f-b9dd-c01dab453eb3-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-45d4728f-54ee-4d4f-b9dd-c01dab453eb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Acquiring lock "cinder-quobyte-2f395296-a2f6-482a-ada5-a468cc793137" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-quobyte-2f395296-a2f6-482a-ada5-a468cc793137" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Acquiring lock "cinder-quobyte-45d4728f-54ee-4d4f-b9dd-c01dab453eb3" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-quobyte-45d4728f-54ee-4d4f-b9dd-c01dab453eb3" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Deleting offline snapshot 45d4728f-54ee-4d4f-b9dd-c01dab453eb3 of volume 2f395296-a2f6-482a-ada5-a468cc793137 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] snapshot_file for this snap is: volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f315577c-4e45-4173-918c-1160dd27cc98]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:12 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 Jul 05 19:44:12 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:13 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3" returned: 0 in 1.215s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f395296-a2f6-482a-ada5-a468cc793137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:44:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e73e0d-ea81-4b6f-922b-8252ad978c08]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:14 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 Jul 05 19:44:14 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:14 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137" returned: 0 in 1.201s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:15 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 Jul 05 19:44:15 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:15 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3" returned: 0 in 0.905s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:15 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3 Jul 05 19:44:15 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:44:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:44:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:44:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:16 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:44:16 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:17 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137.45d4728f-54ee-4d4f-b9dd-c01dab453eb3" returned: 0 in 1.196s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-quobyte-45d4728f-54ee-4d4f-b9dd-c01dab453eb3" released by "_delete_snapshot" :: held 4.685s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-quobyte-2f395296-a2f6-482a-ada5-a468cc793137" released by "delete_snapshot" :: held 4.728s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:44:17 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.064s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Created reservations ['3a1a24cf-aa3b-4148-b6c7-4cbe1807009e', '5699d09b-2b67-4424-a030-16fed370bdad', 'd5777f0d-df64-45ac-81f3-7868646f3bdd', 'e0a73612-1be7-4f2c-b648-3ad3725cd6d4'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:44:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Delete snapshot completed successfully. Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-41a584e9-0165-4314-a43d-bead926e8b81 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-45d4728f-54ee-4d4f-b9dd-c01dab453eb3-delete_snapshot" released by "delete_snapshot" :: held 5.007s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:44:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Acquiring lock "cinder-2f395296-a2f6-482a-ada5-a468cc793137-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:44:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-2f395296-a2f6-482a-ada5-a468cc793137-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:44:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Acquiring lock "cinder-quobyte-2f395296-a2f6-482a-ada5-a468cc793137" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:44:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-quobyte-2f395296-a2f6-482a-ada5-a468cc793137" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:44:18 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f4c05a-0c37-4103-a272-891af721a78f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:18 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 Jul 05 19:44:18 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:19 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137" returned: 0 in 1.533s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:19 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137 Jul 05 19:44:19 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:20 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f395296-a2f6-482a-ada5-a468cc793137" returned: 0 in 1.163s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-quobyte-2f395296-a2f6-482a-ada5-a468cc793137" released by "delete_volume" :: held 2.785s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:44:21 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Created reservations ['8307a804-959e-40b8-820e-f886ed843e29', '626ca5fa-d597-40a8-a22f-ebb32e054af1', 'ddd9bbf1-8646-465c-a480-c02b29794615', '614de50a-70d0-4201-8b45-a3d0cde22192'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:44:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:44:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:44:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:21 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:44:21 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:22 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.436s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:22 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:44:22 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Deleted volume successfully. Jul 05 19:44:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eacb3aaa-a57d-47b1-816b-b1507da21c07 tempest-VolumesSnapshotNegativeTestJSON-393692740 None] Lock "cinder-2f395296-a2f6-482a-ada5-a468cc793137-delete_volume" released by "delete_volume" :: held 4.679s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:44:26 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:44:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Flow 'volume_create_manager' (e195c35b-361b-4d80-b1e1-91116c1348a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1ee602-ecfd-40b9-bb17-7c2e3901424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1ee602-ecfd-40b9-bb17-7c2e3901424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1695191247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298d36a3-7ac9-426b-84be-45ab3b136ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6a8654a799425c8cd00b033a89b4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:27Z,use_quota=True,user_id='6ba581e0c79b46ee800b2576c2ef5013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a349888d-8440-490e-9101-eee6ff750c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a349888d-8440-490e-9101-eee6ff750c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b4d924-4608-4edc-9dc1-bc9953a0c006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b4d924-4608-4edc-9dc1-bc9953a0c006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298d36a3-7ac9-426b-84be-45ab3b136ef1', 'volume_name': 'volume-298d36a3-7ac9-426b-84be-45ab3b136ef1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa362a1-4dd7-4484-a3ed-62784916a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa362a1-4dd7-4484-a3ed-62784916a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cea2d8-41a7-4fcc-8c92-8ae4c90d98f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:27 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Volume 298d36a3-7ac9-426b-84be-45ab3b136ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298d36a3-7ac9-426b-84be-45ab3b136ef1', 'volume_size': 1} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1695191247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298d36a3-7ac9-426b-84be-45ab3b136ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6a8654a799425c8cd00b033a89b4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:27Z,use_quota=True,user_id='6ba581e0c79b46ee800b2576c2ef5013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Creating volume 298d36a3-7ac9-426b-84be-45ab3b136ef1 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:44:27 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:44:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:27 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 1073741824 Jul 05 19:44:27 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:28 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 1073741824" returned: 0 in 1.209s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:28 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 Jul 05 19:44:28 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:28 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:44:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cea2d8-41a7-4fcc-8c92-8ae4c90d98f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298d36a3-7ac9-426b-84be-45ab3b136ef1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eec9c7a-65e1-4d5a-a9c8-de6c7a714430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:29 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Volume volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 (298d36a3-7ac9-426b-84be-45ab3b136ef1): created successfully Jul 05 19:44:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eec9c7a-65e1-4d5a-a9c8-de6c7a714430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Flow 'volume_create_manager' (e195c35b-361b-4d80-b1e1-91116c1348a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d9b21bf7-d096-442a-98f4-ecd4a5656b8c tempest-AttachVolumeNegativeTest-1801146144 None] Created volume successfully. Jul 05 19:44:30 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:44:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Flow 'volume_create_manager' (f0b9edc4-1945-49c7-8473-6fb511e00f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8372b8-f21b-4851-b214-1949d113aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8372b8-f21b-4851-b214-1949d113aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1667917557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab87c36f-08e5-4a4c-852c-23e1ceffdb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df54b2e77c1448249b5d5005a0a30de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:31Z,use_quota=True,user_id='0a88d57eaa6e4fc19f9d5bb054781854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3264fa-bfd6-437c-b103-7cba7781a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3264fa-bfd6-437c-b103-7cba7781a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317f4208-111d-444b-b926-213fe1564047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:30 devstack cinder-volume[86389]: DEBUG cinder.image.glance [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Creating Keystone auth plugin from conf {{(pid=86389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 19:44:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317f4208-111d-444b-b926-213fe1564047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab87c36f-08e5-4a4c-852c-23e1ceffdb48', 'volume_name': 'volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a627e8c-1fc5-4000-992b-8fc9c8f9b56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a627e8c-1fc5-4000-992b-8fc9c8f9b56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19136bb2-c345-4490-8598-567e21f23445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Volume ab87c36f-08e5-4a4c-852c-23e1ceffdb48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 19:44:31 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Trying to clone ab87c36f-08e5-4a4c-852c-23e1ceffdb48 from image aa12a165-b970-4e97-bb87-7bd652f13413 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]). {{(pid=86389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 19:44:31 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 19:44:31 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Image download 20.69 MB at 20.69 MB/s Jul 05 19:44:31 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d09707-d9e3-42e7-a60c-b3d8828d319d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:31 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD Jul 05 19:44:31 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:32 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:32 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Temporary image aa12a165-b970-4e97-bb87-7bd652f13413 is fetched for user 0a88d57eaa6e4fc19f9d5bb054781854. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 19:44:32 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[393515ef-ab95-419b-a684-5c7a2f94e615]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:32 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD Jul 05 19:44:32 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-90f14b65-0b4b-495c-86de-e14f7588394e req-a2f28648-599d-44a2-9a77-43def96480fb tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-90f14b65-0b4b-495c-86de-e14f7588394e req-a2f28648-599d-44a2-9a77-43def96480fb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c02ce9e-ba5c-44b3-b994-484e24b77cf3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-90f14b65-0b4b-495c-86de-e14f7588394e req-a2f28648-599d-44a2-9a77-43def96480fb tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:33 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 Jul 05 19:44:33 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:33 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD" returned: 0 in 1.033s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:34 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-90f14b65-0b4b-495c-86de-e14f7588394e req-a2f28648-599d-44a2-9a77-43def96480fb tempest-AttachVolumeNegativeTest-1801146144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1" returned: 0 in 0.968s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-90f14b65-0b4b-495c-86de-e14f7588394e req-a2f28648-599d-44a2-9a77-43def96480fb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.991s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.565s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1667917557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab87c36f-08e5-4a4c-852c-23e1ceffdb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df54b2e77c1448249b5d5005a0a30de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:31Z,use_quota=True,user_id='0a88d57eaa6e4fc19f9d5bb054781854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Creating volume ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:44:34 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:34 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 1073741824 Jul 05 19:44:34 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-90f14b65-0b4b-495c-86de-e14f7588394e req-a2f28648-599d-44a2-9a77-43def96480fb tempest-AttachVolumeNegativeTest-1801146144 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-298d36a3-7ac9-426b-84be-45ab3b136ef1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec319074-c5a8-46be-9400-4ac882f5df9b', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:44:34 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-90f14b65-0b4b-495c-86de-e14f7588394e req-a2f28648-599d-44a2-9a77-43def96480fb tempest-AttachVolumeNegativeTest-1801146144 None] attachment_update completed successfully. Jul 05 19:44:36 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 1073741824" returned: 0 in 1.784s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:36 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:44:36 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:37 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 0 in 0.988s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] <== create_volume: return (2822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:44:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.837s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:37 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Attempting download of aa12a165-b970-4e97-bb87-7bd652f13413 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}])) to volume ab87c36f-08e5-4a4c-852c-23e1ceffdb48. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 19:44:37 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a160ca5c-ed85-4a2a-85a5-74013fcea22b]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_3o3ag9ea {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:37 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_3o3ag9ea Jul 05 19:44:37 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:38 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_3o3ag9ea" returned: 0 in 1.410s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_3o3ag9ea {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:38 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_3o3ag9ea Jul 05 19:44:38 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:39 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_3o3ag9ea" returned: 1 in 1.033s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa12a165-b970-4e97-bb87-7bd652f13413_3o3ag9ea' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:44:39 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[21003f08-fb9f-487b-9f1f-80c8b59d6854]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:39 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD Jul 05 19:44:39 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:40 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD" returned: 0 in 1.057s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:40 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] aa12a165-b970-4e97-bb87-7bd652f13413 was qcow2, converting to raw {{(pid=86389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 19:44:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:40 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:44:40 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:43 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 0 in 2.578s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:43 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa12a165-b970-4e97-bb87-7bd652f13413_nokbxx3ndevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:44:43 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Converted 112.00 MB image at 43.43 MB/s Jul 05 19:44:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:43 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 1G Jul 05 19:44:43 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:44 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 1G" returned: 0 in 0.820s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:44 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbdde5f-55bd-4bae-9498-f93f17f28f6b]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:44 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:44:44 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:45 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 0 in 0.883s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:45 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:44:45 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:46 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 1 in 0.920s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Downloaded image aa12a165-b970-4e97-bb87-7bd652f13413 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}])) to volume ab87c36f-08e5-4a4c-852c-23e1ceffdb48 successfully. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Temporary image aa12a165-b970-4e97-bb87-7bd652f13413 for user 0a88d57eaa6e4fc19f9d5bb054781854 is deleted. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Marking volume ab87c36f-08e5-4a4c-852c-23e1ceffdb48 as bootable. {{(pid=86389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=57,cinder:SELECT=51,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Copying metadata from image aa12a165-b970-4e97-bb87-7bd652f13413 to ab87c36f-08e5-4a4c-852c-23e1ceffdb48. {{(pid=86389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Creating volume glance metadata for volume ab87c36f-08e5-4a4c-852c-23e1ceffdb48 backed by image aa12a165-b970-4e97-bb87-7bd652f13413 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=50,cinder:INSERT=16,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19136bb2-c345-4490-8598-567e21f23445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48', 'volume_size': 1, 'image_id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa12a165-b970-4e97-bb87-7bd652f13413', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '218bfc61d197450aa08d1f13bcdf19af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa12a165-b970-4e97-bb87-7bd652f13413', 'created_at': datetime.datetime(2026, 7, 5, 17, 30, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa12a165-b970-4e97-bb87-7bd652f13413/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13df5f42-46f3-4d2d-89f1-fe7c61869694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:46 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Volume volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 (ab87c36f-08e5-4a4c-852c-23e1ceffdb48): created successfully Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13df5f42-46f3-4d2d-89f1-fe7c61869694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Flow 'volume_create_manager' (f0b9edc4-1945-49c7-8473-6fb511e00f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-45250042-ff63-4c2b-85c7-7542bad88248 tempest-TestShelveInstance-2067324130 None] Created volume successfully. Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Flow 'volume_create_manager' (35a0fca0-693c-478e-8290-fdbd45dce2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1913d2c4-0ac9-43fb-b281-6e793293ac1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1913d2c4-0ac9-43fb-b281-6e793293ac1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-973139241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27319c5-15e0-4969-a845-d115ddee34aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb1385f5e5443a28ea538d847c2c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:48Z,use_quota=True,user_id='4ae72c5f4e854845b54b99e84d41ed3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d0d8ee-901e-4c1f-9bd7-bf09eec3f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d0d8ee-901e-4c1f-9bd7-bf09eec3f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d03a016-3e30-4481-84d0-86a7ce851dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d03a016-3e30-4481-84d0-86a7ce851dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27319c5-15e0-4969-a845-d115ddee34aa', 'volume_name': 'volume-a27319c5-15e0-4969-a845-d115ddee34aa', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1842b6-b753-4346-96ec-246adee9c4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1842b6-b753-4346-96ec-246adee9c4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b05827d-a3de-47dc-a45a-e376b8bc6afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:47 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Volume a27319c5-15e0-4969-a845-d115ddee34aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27319c5-15e0-4969-a845-d115ddee34aa', 'volume_size': 1} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-973139241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27319c5-15e0-4969-a845-d115ddee34aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb1385f5e5443a28ea538d847c2c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:48Z,use_quota=True,user_id='4ae72c5f4e854845b54b99e84d41ed3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Creating volume a27319c5-15e0-4969-a845-d115ddee34aa {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:44:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:44:48 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:44:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:48 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa 1073741824 Jul 05 19:44:48 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:49 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa 1073741824" returned: 0 in 1.179s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:49 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa Jul 05 19:44:49 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:49 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa" returned: 0 in 0.670s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:44:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b05827d-a3de-47dc-a45a-e376b8bc6afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27319c5-15e0-4969-a845-d115ddee34aa', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ac1b28-b4f4-442b-b7ff-242ca22a2471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:49 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Volume volume-a27319c5-15e0-4969-a845-d115ddee34aa (a27319c5-15e0-4969-a845-d115ddee34aa): created successfully Jul 05 19:44:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ac1b28-b4f4-442b-b7ff-242ca22a2471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Flow 'volume_create_manager' (35a0fca0-693c-478e-8290-fdbd45dce2bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:49 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d5a80d08-b6d5-4234-ba34-8379d8348b57 tempest-ServersNegativeTestJSON-1895186744 None] Created volume successfully. Jul 05 19:44:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:54 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2285737b-5a47-4461-aee4-18bc2a632834]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:44:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:54 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:44:54 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:55 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 0 in 1.262s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:56 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:44:56 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Flow 'volume_create_manager' (57da17ec-6146-4610-a890-6a5320c29f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd1995f-2e84-4c98-a0a7-4a656b69d4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd1995f-2e84-4c98-a0a7-4a656b69d4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-810656931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1503d57-ffb8-41fc-aba1-7f147df814ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb1385f5e5443a28ea538d847c2c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:56Z,use_quota=True,user_id='4ae72c5f4e854845b54b99e84d41ed3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d71157-9dae-48e2-9318-0d9818ef3982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d71157-9dae-48e2-9318-0d9818ef3982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4ba745-29bd-43a5-a4ea-36beee7342ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4ba745-29bd-43a5-a4ea-36beee7342ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1503d57-ffb8-41fc-aba1-7f147df814ac', 'volume_name': 'volume-f1503d57-ffb8-41fc-aba1-7f147df814ac', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e2a0d2-5417-4c21-8087-b5bd8503835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e2a0d2-5417-4c21-8087-b5bd8503835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f62626-1237-43f5-8d57-7f88d7af8b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:56 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Volume f1503d57-ffb8-41fc-aba1-7f147df814ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1503d57-ffb8-41fc-aba1-7f147df814ac', 'volume_size': 1} Jul 05 19:44:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:57 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 1 in 1.303s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.636s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-810656931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1503d57-ffb8-41fc-aba1-7f147df814ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb1385f5e5443a28ea538d847c2c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:44:56Z,use_quota=True,user_id='4ae72c5f4e854845b54b99e84d41ed3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Creating volume f1503d57-ffb8-41fc-aba1-7f147df814ac {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:44:57 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:57 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac 1073741824 Jul 05 19:44:57 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7f89876-8269-4121-ab67-b7eefbe1b8e5', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:44:57 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-f73686f8-5f2d-4875-ad4e-245498e2a486 req-196d779b-a1f2-440d-b274-0acae3b0d043 tempest-TestShelveInstance-2067324130 None] attachment_update completed successfully. Jul 05 19:44:58 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac 1073741824" returned: 0 in 1.693s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:44:58 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac Jul 05 19:44:58 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:44:59 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 05 19:44:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac" returned: 0 in 0.823s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:44:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] <== create_volume: return (2578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:44:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.580s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:44:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f62626-1237-43f5-8d57-7f88d7af8b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1503d57-ffb8-41fc-aba1-7f147df814ac', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81161749-982d-4b00-93b2-e49039f52593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:44:59 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Volume volume-f1503d57-ffb8-41fc-aba1-7f147df814ac (f1503d57-ffb8-41fc-aba1-7f147df814ac): created successfully Jul 05 19:44:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81161749-982d-4b00-93b2-e49039f52593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:44:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Flow 'volume_create_manager' (57da17ec-6146-4610-a890-6a5320c29f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:44:59 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4dd8b3bf-9ce6-4153-bddc-8562b476186e tempest-ServersNegativeTestJSON-1895186744 None] Created volume successfully. Jul 05 19:45:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "cinder-f1503d57-ffb8-41fc-aba1-7f147df814ac-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:45:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Lock "cinder-f1503d57-ffb8-41fc-aba1-7f147df814ac-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:45:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "cinder-quobyte-f1503d57-ffb8-41fc-aba1-7f147df814ac" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:45:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Lock "cinder-quobyte-f1503d57-ffb8-41fc-aba1-7f147df814ac" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:45:01 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4521c074-0492-417b-9fba-5de0643dc877]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:45:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:02 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac Jul 05 19:45:02 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:04 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac" returned: 0 in 2.522s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:04 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac Jul 05 19:45:04 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:05 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f1503d57-ffb8-41fc-aba1-7f147df814ac" returned: 0 in 0.840s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Lock "cinder-quobyte-f1503d57-ffb8-41fc-aba1-7f147df814ac" released by "delete_volume" :: held 3.484s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:45:05 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Created reservations ['f228d822-e1db-4915-9b35-98cfe6bdc685', 'a023a832-1340-4d08-8dfc-48bd7c0d7038', '23e7927f-3bf8-4d5a-b69a-7361c3b5a248', '0a299176-4e57-4bb3-8ba8-2829ac936257'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:45:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:45:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:45:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:05 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:45:05 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "cinder-a27319c5-15e0-4969-a845-d115ddee34aa-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:45:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Lock "cinder-a27319c5-15e0-4969-a845-d115ddee34aa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:45:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "cinder-quobyte-a27319c5-15e0-4969-a845-d115ddee34aa" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:45:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Lock "cinder-quobyte-a27319c5-15e0-4969-a845-d115ddee34aa" acquired by "delete_volume" :: waited 0.080s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:45:06 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd817e-a0f0-4cc4-a8e1-e2db99def5b4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:45:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:07 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa Jul 05 19:45:07 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:07 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.653s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:07 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:45:07 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Deleted volume successfully. Jul 05 19:45:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-585bda8e-abb5-4ce9-bb4c-f8600686b05f tempest-ServersNegativeTestJSON-1895186744 None] Lock "cinder-f1503d57-ffb8-41fc-aba1-7f147df814ac-delete_volume" released by "delete_volume" :: held 5.603s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:45:08 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa" returned: 0 in 2.003s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:08 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa Jul 05 19:45:08 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:09 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a27319c5-15e0-4969-a845-d115ddee34aa" returned: 0 in 1.090s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Lock "cinder-quobyte-a27319c5-15e0-4969-a845-d115ddee34aa" released by "delete_volume" :: held 3.203s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:45:10 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Created reservations ['0f877e57-602f-4591-ad6d-e13ba824e18d', '96091e95-2f0c-4391-850a-05579ee6f52d', '5e724fe1-980d-400c-9075-b645ecd35a9c', '64d9840f-831a-48b1-8ffe-18d947ab654e'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:45:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:45:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:45:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:10 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:45:10 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:11 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.109s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:11 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:45:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Deleted volume successfully. Jul 05 19:45:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-452aa84a-ffa6-4ba5-a526-67e46be02787 tempest-ServersNegativeTestJSON-1895186744 None] Lock "cinder-a27319c5-15e0-4969-a845-d115ddee34aa-delete_volume" released by "delete_volume" :: held 4.861s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:45:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:45:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:45:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:45:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:16 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:45:16 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:16 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.822s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:45:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:45:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:45:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:45:20 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=32,cinder:INSERT=15,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:45:21 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:INSERT=7,cinder:SELECT=20,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Flow 'volume_create_manager' (3cbda6ba-0c15-4259-9f31-382fc9670f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdd683f-73ab-4569-8dda-302b7e341382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdd683f-73ab-4569-8dda-302b7e341382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1771932086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba76ae9-32d8-459c-bf59-de5a4673e9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec25792a2946dea53f881b0ab1a25a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:45:27Z,use_quota=True,user_id='3fa29e9fb34c4dd7804050ed432e58ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8b535c-e9e3-485a-95ac-ac222bf78d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8b535c-e9e3-485a-95ac-ac222bf78d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d9abf0-0033-47d3-9cea-3e57187ecfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d9abf0-0033-47d3-9cea-3e57187ecfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba76ae9-32d8-459c-bf59-de5a4673e9f3', 'volume_name': 'volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b712a5-8378-4cde-b428-1fb950cba558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b712a5-8378-4cde-b428-1fb950cba558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e620b43-68ba-4328-bf9c-fa6fd87581d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:27 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Volume 1ba76ae9-32d8-459c-bf59-de5a4673e9f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3', 'volume_size': 1} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1771932086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba76ae9-32d8-459c-bf59-de5a4673e9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec25792a2946dea53f881b0ab1a25a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:45:27Z,use_quota=True,user_id='3fa29e9fb34c4dd7804050ed432e58ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Creating volume 1ba76ae9-32d8-459c-bf59-de5a4673e9f3 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:45:27 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:45:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:27 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 1073741824 Jul 05 19:45:27 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:28 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 1073741824" returned: 0 in 0.999s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:28 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 Jul 05 19:45:28 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:29 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3" returned: 0 in 1.223s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:45:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e620b43-68ba-4328-bf9c-fa6fd87581d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67441e5-4503-472d-b006-6ffdcece9402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:29 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Volume volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 (1ba76ae9-32d8-459c-bf59-de5a4673e9f3): created successfully Jul 05 19:45:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67441e5-4503-472d-b006-6ffdcece9402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Flow 'volume_create_manager' (3cbda6ba-0c15-4259-9f31-382fc9670f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:45:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6225ba6c-32fe-44ef-a098-984def964048 tempest-TestMinimumBasicScenario-610054833 None] Created volume successfully. Jul 05 19:45:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1e54b4f9-0d45-4387-ad90-4b8e315eb9b4 req-fa6d2201-b876-467c-99f7-20fa6541965e tempest-TestMinimumBasicScenario-610054833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1e54b4f9-0d45-4387-ad90-4b8e315eb9b4 req-fa6d2201-b876-467c-99f7-20fa6541965e tempest-TestMinimumBasicScenario-610054833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:34 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619320c-1463-40b0-af44-e01a916ef6f3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:45:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-1e54b4f9-0d45-4387-ad90-4b8e315eb9b4 req-fa6d2201-b876-467c-99f7-20fa6541965e tempest-TestMinimumBasicScenario-610054833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:34 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 Jul 05 19:45:34 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:35 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-1e54b4f9-0d45-4387-ad90-4b8e315eb9b4 req-fa6d2201-b876-467c-99f7-20fa6541965e tempest-TestMinimumBasicScenario-610054833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3" returned: 0 in 1.167s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1e54b4f9-0d45-4387-ad90-4b8e315eb9b4 req-fa6d2201-b876-467c-99f7-20fa6541965e tempest-TestMinimumBasicScenario-610054833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.198s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-1e54b4f9-0d45-4387-ad90-4b8e315eb9b4 req-fa6d2201-b876-467c-99f7-20fa6541965e tempest-TestMinimumBasicScenario-610054833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '613c72b3-acd3-47c5-8170-98cbed1e43f8', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:45:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-1e54b4f9-0d45-4387-ad90-4b8e315eb9b4 req-fa6d2201-b876-467c-99f7-20fa6541965e tempest-TestMinimumBasicScenario-610054833 None] attachment_update completed successfully. Jul 05 19:45:38 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-0d0d2a88-96b9-487a-a653-65e33811cb71 req-bf51eb83-229d-41a4-8b6c-6706b6ac2d2b tempest-AttachVolumeNegativeTest-1801146144 None] Terminate volume connection completed successfully. Jul 05 19:45:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-0d0d2a88-96b9-487a-a653-65e33811cb71 req-bf51eb83-229d-41a4-8b6c-6706b6ac2d2b tempest-AttachVolumeNegativeTest-1801146144 None] Deleting attachment ec319074-c5a8-46be-9400-4ac882f5df9b. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:45:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-7ccf2608-5ad0-46b0-abce-d60cfc36e7d5 req-b57ea628-d1db-43a6-98a7-f114d7d391bd tempest-TestShelveInstance-2067324130 None] Terminate volume connection completed successfully. Jul 05 19:45:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-7ccf2608-5ad0-46b0-abce-d60cfc36e7d5 req-b57ea628-d1db-43a6-98a7-f114d7d391bd tempest-TestShelveInstance-2067324130 None] Deleting attachment c7f89876-8269-4121-ab67-b7eefbe1b8e5. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:45:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:51 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3edf30-e781-4518-9f39-dec266846ad7]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:45:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:51 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:45:51 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 0 in 1.079s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:52 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:52 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:45:52 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Flow 'volume_create_manager' (87e662a5-4e66-4b19-8a3e-61fa16517a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3919e42-9d9d-484b-aaaa-1d88088c04d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3919e42-9d9d-484b-aaaa-1d88088c04d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-159063267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91ee15a-5c88-48ae-a307-88cb6cc478ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735ede53f49d474dbc0b1e62dfb75d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:45:52Z,use_quota=True,user_id='04ee3603b5b2490f8e5b2fce7dde7e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3aff9d-59bb-44f6-a0e1-ba1890163684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3aff9d-59bb-44f6-a0e1-ba1890163684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d36016-e0b7-4edf-881f-feb0306dbb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d36016-e0b7-4edf-881f-feb0306dbb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91ee15a-5c88-48ae-a307-88cb6cc478ec', 'volume_name': 'volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217225be-6827-40bb-8196-fba8f28ee517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217225be-6827-40bb-8196-fba8f28ee517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248d9c02-ff49-47e4-bf86-e65059a669fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:52 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Volume c91ee15a-5c88-48ae-a307-88cb6cc478ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec', 'volume_size': 1} Jul 05 19:45:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:53 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 1 in 0.849s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.977s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.507s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-159063267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91ee15a-5c88-48ae-a307-88cb6cc478ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735ede53f49d474dbc0b1e62dfb75d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:45:52Z,use_quota=True,user_id='04ee3603b5b2490f8e5b2fce7dde7e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Creating volume c91ee15a-5c88-48ae-a307-88cb6cc478ec {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:45:53 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:53 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec 1073741824 Jul 05 19:45:53 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13f019f8-04ae-46e3-b58f-4d379e2e2d58', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:45:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-ad5b2941-f2e4-41be-abe5-72c8d7af5d7e req-b2af7173-586f-4682-9ce7-a0cc1dac613e tempest-TestShelveInstance-2067324130 None] attachment_update completed successfully. Jul 05 19:45:53 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec 1073741824" returned: 0 in 0.941s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:54 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec Jul 05 19:45:54 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:54 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec" returned: 0 in 0.798s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:45:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248d9c02-ff49-47e4-bf86-e65059a669fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e07e489-2371-4c3c-a3ea-aece556ee0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:54 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Volume volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec (c91ee15a-5c88-48ae-a307-88cb6cc478ec): created successfully Jul 05 19:45:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e07e489-2371-4c3c-a3ea-aece556ee0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Flow 'volume_create_manager' (87e662a5-4e66-4b19-8a3e-61fa16517a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:45:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c528cf3f-c0b9-46cc-9d1a-82b15ec12420 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Created volume successfully. Jul 05 19:45:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Acquiring lock "cinder-c91ee15a-5c88-48ae-a307-88cb6cc478ec-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:45:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "cinder-c91ee15a-5c88-48ae-a307-88cb6cc478ec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:45:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Acquiring lock "cinder-quobyte-c91ee15a-5c88-48ae-a307-88cb6cc478ec" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:45:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "cinder-quobyte-c91ee15a-5c88-48ae-a307-88cb6cc478ec" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:45:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb276a0-f189-4794-93a6-cc4d1f1b3b11]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:45:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:55 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec Jul 05 19:45:55 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:56 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec" returned: 0 in 0.808s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:56 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec Jul 05 19:45:56 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:56 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c91ee15a-5c88-48ae-a307-88cb6cc478ec" returned: 0 in 0.635s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "cinder-quobyte-c91ee15a-5c88-48ae-a307-88cb6cc478ec" released by "delete_volume" :: held 1.478s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Created reservations ['37a8a140-d631-432a-8596-03da2342c2e1', '69300659-fd23-4496-9095-6198aba290cc', '53717cd6-6ef3-42d6-af0c-4423d3671689', 'ceef4056-8696-403e-a640-dbf847bc7243'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:57 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:45:57 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:57 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.678s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:45:57 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Deleted volume successfully. Jul 05 19:45:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94a32cbd-9f4a-491f-b822-94084a6e7733 tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "cinder-c91ee15a-5c88-48ae-a307-88cb6cc478ec-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Flow 'volume_create_manager' (c648962b-ec5e-43b8-a503-d60bb9c4f244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e350f824-4b1a-4f95-b5a6-1833aac95ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e350f824-4b1a-4f95-b5a6-1833aac95ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1264327018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef9345b-55ba-486e-874d-b561e7596e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735ede53f49d474dbc0b1e62dfb75d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:45:58Z,use_quota=True,user_id='04ee3603b5b2490f8e5b2fce7dde7e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369b5ad1-bda7-4b35-ba18-4e86b52144b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369b5ad1-bda7-4b35-ba18-4e86b52144b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e323019-fc18-45d2-b7a0-46d34b6788c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e323019-fc18-45d2-b7a0-46d34b6788c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef9345b-55ba-486e-874d-b561e7596e64', 'volume_name': 'volume-0ef9345b-55ba-486e-874d-b561e7596e64', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b2d856-5dc6-418e-b3d4-9b8f266226db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b2d856-5dc6-418e-b3d4-9b8f266226db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99cd5a8-801f-44cf-b2b7-92c5cfd893b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:45:58 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Volume 0ef9345b-55ba-486e-874d-b561e7596e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef9345b-55ba-486e-874d-b561e7596e64', 'volume_size': 1} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1264327018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef9345b-55ba-486e-874d-b561e7596e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735ede53f49d474dbc0b1e62dfb75d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:45:58Z,use_quota=True,user_id='04ee3603b5b2490f8e5b2fce7dde7e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Creating volume 0ef9345b-55ba-486e-874d-b561e7596e64 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:45:58 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:45:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:58 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64 1073741824 Jul 05 19:45:58 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:45:59 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Jul 05 19:45:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64 1073741824" returned: 0 in 0.931s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:45:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:45:59 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64 Jul 05 19:45:59 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:00 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64" returned: 0 in 0.680s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:46:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99cd5a8-801f-44cf-b2b7-92c5cfd893b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef9345b-55ba-486e-874d-b561e7596e64', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31b86f7-e17b-4c5e-9f70-d01007e81c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:00 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Volume volume-0ef9345b-55ba-486e-874d-b561e7596e64 (0ef9345b-55ba-486e-874d-b561e7596e64): created successfully Jul 05 19:46:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31b86f7-e17b-4c5e-9f70-d01007e81c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Flow 'volume_create_manager' (c648962b-ec5e-43b8-a503-d60bb9c4f244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:00 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-220265e4-cf4c-45e1-a999-af8518eb178c tempest-VolumeQuotasAdminTestJSON-1621549744 None] Created volume successfully. Jul 05 19:46:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-22ff2574-fb27-4ecf-afe4-341dc1f8f8d8 tempest-VolumeQuotasAdminTestJSON-2036050563 None] Transfer volume completed successfully. Jul 05 19:46:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Acquiring lock "cinder-0ef9345b-55ba-486e-874d-b561e7596e64-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Lock "cinder-0ef9345b-55ba-486e-874d-b561e7596e64-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Acquiring lock "cinder-quobyte-0ef9345b-55ba-486e-874d-b561e7596e64" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Lock "cinder-quobyte-0ef9345b-55ba-486e-874d-b561e7596e64" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:02 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e40a6-9e49-408d-bd22-66582f79fac0]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:46:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:02 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64 Jul 05 19:46:02 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:04 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64" returned: 0 in 2.287s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:04 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64 Jul 05 19:46:04 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:05 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0ef9345b-55ba-486e-874d-b561e7596e64" returned: 0 in 0.968s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Lock "cinder-quobyte-0ef9345b-55ba-486e-874d-b561e7596e64" released by "delete_volume" :: held 3.359s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:05 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Created reservations ['6877c583-c4d5-4817-b697-e6c4c09d8aa7', 'a1cfb167-fb52-4149-ac07-661fe9391c9f', 'fad39a70-464f-40db-895b-9cd06836b739', 'd8bc21b4-0f1d-4e90-ab82-49116433e0a8'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:46:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:06 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:46:06 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:07 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.260s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:07 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:46:07 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Deleted volume successfully. Jul 05 19:46:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-218cb07d-e509-43a0-9e9b-912a9e284481 tempest-VolumeQuotasAdminTestJSON-2073210584 None] Lock "cinder-0ef9345b-55ba-486e-874d-b561e7596e64-delete_volume" released by "delete_volume" :: held 4.978s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:15 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=28,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=5 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:46:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:46:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:16 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:46:16 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:17 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=31,cinder:INSERT=6,cinder:SELECT=31,cinder:DELETE=4 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:46:17 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.135s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:46:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:46:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:46:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Flow 'volume_create_manager' (aafc01a7-b562-452d-8255-9456bdabb40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fb48c2-da99-47f7-b3c5-caf9c59ae324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fb48c2-da99-47f7-b3c5-caf9c59ae324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-968603894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c06a7a-574a-4fbc-960a-5a71c1f8357a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b723aa6f744a919b39abea48dc73e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:19Z,use_quota=True,user_id='08a23101398d42d99f71d46d8f78bf92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11f623e8-18e8-44d9-beb1-43049dbdfce7),volume_type_id=11f623e8-18e8-44d9-beb1-43049dbdfce7)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4aefe3-3aaf-4632-988d-94547d491fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4aefe3-3aaf-4632-988d-94547d491fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a42734-33b6-4882-a1c6-0692f52dbf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a42734-33b6-4882-a1c6-0692f52dbf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c06a7a-574a-4fbc-960a-5a71c1f8357a', 'volume_name': 'volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf822edc-3937-42bf-9a5e-22cdda13f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf822edc-3937-42bf-9a5e-22cdda13f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1ac954-4ef1-4d85-808d-e7bfe19e2cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:19 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Volume 72c06a7a-574a-4fbc-960a-5a71c1f8357a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a', 'volume_size': 1} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-968603894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c06a7a-574a-4fbc-960a-5a71c1f8357a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b723aa6f744a919b39abea48dc73e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:19Z,use_quota=True,user_id='08a23101398d42d99f71d46d8f78bf92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11f623e8-18e8-44d9-beb1-43049dbdfce7),volume_type_id=11f623e8-18e8-44d9-beb1-43049dbdfce7)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Creating volume 72c06a7a-574a-4fbc-960a-5a71c1f8357a {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:46:19 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:46:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:19 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a 1073741824 Jul 05 19:46:19 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:20 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a 1073741824" returned: 0 in 0.925s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:20 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a Jul 05 19:46:20 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:21 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a" returned: 0 in 0.692s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1ac954-4ef1-4d85-808d-e7bfe19e2cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ef05b7-f239-42de-8498-ac93421dcfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:21 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Volume volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a (72c06a7a-574a-4fbc-960a-5a71c1f8357a): created successfully Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ef05b7-f239-42de-8498-ac93421dcfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Flow 'volume_create_manager' (aafc01a7-b562-452d-8255-9456bdabb40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:21 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-07f31d76-e2b1-4576-9b65-80e624429487 tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Created volume successfully. Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7097d927-3f77-44fe-883f-68a59c94b02a tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7097d927-3f77-44fe-883f-68a59c94b02a tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7097d927-3f77-44fe-883f-68a59c94b02a tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7097d927-3f77-44fe-883f-68a59c94b02a tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7097d927-3f77-44fe-883f-68a59c94b02a tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7097d927-3f77-44fe-883f-68a59c94b02a tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:21 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:46:21 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:22 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7097d927-3f77-44fe-883f-68a59c94b02a tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.646s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:22 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7097d927-3f77-44fe-883f-68a59c94b02a tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:46:22 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7097d927-3f77-44fe-883f-68a59c94b02a tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Retype volume completed successfully. Jul 05 19:46:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Acquiring lock "cinder-72c06a7a-574a-4fbc-960a-5a71c1f8357a-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "cinder-72c06a7a-574a-4fbc-960a-5a71c1f8357a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Acquiring lock "cinder-quobyte-72c06a7a-574a-4fbc-960a-5a71c1f8357a" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "cinder-quobyte-72c06a7a-574a-4fbc-960a-5a71c1f8357a" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:23 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3075aaef-c968-4607-8e1d-6bb89ce3c772]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:46:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:23 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a Jul 05 19:46:23 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:23 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a" returned: 0 in 0.775s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:23 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a Jul 05 19:46:23 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:24 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-72c06a7a-574a-4fbc-960a-5a71c1f8357a" returned: 0 in 0.717s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "cinder-quobyte-72c06a7a-574a-4fbc-960a-5a71c1f8357a" released by "delete_volume" :: held 1.535s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:24 devstack cinder-volume[86389]: WARNING cinder.quota [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:46:24 devstack cinder-volume[86389]: WARNING cinder.quota [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:46:24 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Created reservations ['7d4d9f2c-536b-4de1-8e82-d8832488e3f7', '0dbcc056-6b5a-4525-bed6-f5900313386b', '95a9b313-7d6d-4ee7-83f9-c4b363fa9087', '1ccfbae3-3bdd-4fb5-bd0d-d89fff228611'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:46:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:24 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:46:24 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:25 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:25 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:46:25 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Deleted volume successfully. Jul 05 19:46:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bdc48280-6f18-42cb-8da0-38793f0cf52e tempest-VolumeRetypeWithoutMigrationTest-1601068318 None] Lock "cinder-72c06a7a-574a-4fbc-960a-5a71c1f8357a-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:34 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=15,cinder:SELECT=11,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:46:35 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=17,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:46:37 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:46:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Flow 'volume_create_manager' (fbeebfe2-7b18-4743-ad77-0d9425e4692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5693af9a-305e-4687-a706-9cc6effd8bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5693af9a-305e-4687-a706-9cc6effd8bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-639385874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d53096-748a-4927-ba27-c162b6d028b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6a8654a799425c8cd00b033a89b4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:38Z,use_quota=True,user_id='6ba581e0c79b46ee800b2576c2ef5013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7aa57c-4337-4010-8b4b-266203496147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7aa57c-4337-4010-8b4b-266203496147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abda948-aa3d-4267-b788-242327c90b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abda948-aa3d-4267-b788-242327c90b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d53096-748a-4927-ba27-c162b6d028b0', 'volume_name': 'volume-42d53096-748a-4927-ba27-c162b6d028b0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e964f1a-d9c3-4989-ae29-0e6f3bb319e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e964f1a-d9c3-4989-ae29-0e6f3bb319e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4188cc34-64b4-41f4-802e-1e7487132be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:38 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Volume 42d53096-748a-4927-ba27-c162b6d028b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d53096-748a-4927-ba27-c162b6d028b0', 'volume_size': 1} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-639385874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d53096-748a-4927-ba27-c162b6d028b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6a8654a799425c8cd00b033a89b4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:38Z,use_quota=True,user_id='6ba581e0c79b46ee800b2576c2ef5013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Creating volume 42d53096-748a-4927-ba27-c162b6d028b0 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:46:38 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:38 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 1073741824 Jul 05 19:46:38 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:38 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 1073741824" returned: 0 in 0.867s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:38 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 Jul 05 19:46:38 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:39 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0" returned: 0 in 0.650s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4188cc34-64b4-41f4-802e-1e7487132be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d53096-748a-4927-ba27-c162b6d028b0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c1e0ed-df35-4798-96f9-9ec5e0f7995c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:39 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Volume volume-42d53096-748a-4927-ba27-c162b6d028b0 (42d53096-748a-4927-ba27-c162b6d028b0): created successfully Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c1e0ed-df35-4798-96f9-9ec5e0f7995c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Flow 'volume_create_manager' (fbeebfe2-7b18-4743-ad77-0d9425e4692b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:39 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a7dd087c-47cc-4617-91ad-ddb82c3b4f8d tempest-AttachVolumeNegativeTest-1801146144 None] Created volume successfully. Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Flow 'volume_create_manager' (020686ea-34ed-4fbb-aea0-85d05efe446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50911b8-fddc-431f-888b-24d7ed5d18d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50911b8-fddc-431f-888b-24d7ed5d18d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1681063232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229962be497443fb1b777e50856a244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:40Z,use_quota=True,user_id='83a55311e80f48fe8b1e3179c160ce41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6625a88-76b7-414b-86c0-59aaabe9b61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6625a88-76b7-414b-86c0-59aaabe9b61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378d4be5-4922-457c-9e44-3189fba261d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378d4be5-4922-457c-9e44-3189fba261d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0', 'volume_name': 'volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e22345c-fd3b-4d67-b22f-560e6c94396a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e22345c-fd3b-4d67-b22f-560e6c94396a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4b21a9-ff2c-40d0-8190-a564a564b0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:39 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Volume 7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0', 'volume_size': 1} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1681063232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229962be497443fb1b777e50856a244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:40Z,use_quota=True,user_id='83a55311e80f48fe8b1e3179c160ce41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Creating volume 7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:46:39 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:46:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:39 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 1073741824 Jul 05 19:46:39 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:40 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 1073741824" returned: 0 in 0.850s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:40 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 Jul 05 19:46:40 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:41 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0" returned: 0 in 0.663s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:46:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4b21a9-ff2c-40d0-8190-a564a564b0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1472a7b9-a834-4738-8ee8-037b77d0dfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:41 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Volume volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 (7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0): created successfully Jul 05 19:46:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1472a7b9-a834-4738-8ee8-037b77d0dfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Flow 'volume_create_manager' (020686ea-34ed-4fbb-aea0-85d05efe446c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:41 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b5d546b4-5dbd-407a-b249-c9591b12e703 tempest-VolumesListAdminTestJSON-182919492 None] Created volume successfully. Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Flow 'volume_create_manager' (f852bb9f-5e20-43a4-a98c-b56fb1c57e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f3bc94-8576-422f-abb6-76a714d7ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f3bc94-8576-422f-abb6-76a714d7ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2031722529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff039762-139d-4b14-8708-59dc511c5a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229962be497443fb1b777e50856a244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:42Z,use_quota=True,user_id='83a55311e80f48fe8b1e3179c160ce41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ee4029-157c-4cd0-8f75-5425bb012aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ee4029-157c-4cd0-8f75-5425bb012aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a646a1-4c5c-46f5-a016-72c8b90b6884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a646a1-4c5c-46f5-a016-72c8b90b6884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff039762-139d-4b14-8708-59dc511c5a44', 'volume_name': 'volume-ff039762-139d-4b14-8708-59dc511c5a44', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0749114-c455-4217-a237-8d1cd71f2835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0749114-c455-4217-a237-8d1cd71f2835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedba01f-e92f-4539-a0a4-d5f9de4dc5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:42 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Volume ff039762-139d-4b14-8708-59dc511c5a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff039762-139d-4b14-8708-59dc511c5a44', 'volume_size': 1} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2031722529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff039762-139d-4b14-8708-59dc511c5a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229962be497443fb1b777e50856a244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:42Z,use_quota=True,user_id='83a55311e80f48fe8b1e3179c160ce41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Creating volume ff039762-139d-4b14-8708-59dc511c5a44 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:46:42 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:46:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:42 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44 1073741824 Jul 05 19:46:42 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-43e741e5-23b1-4355-9e47-43fd3d1689bd req-d22453fe-e9ae-4804-b26b-d662c384c561 tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:43 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44 1073741824" returned: 0 in 1.042s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:43 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44 Jul 05 19:46:43 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:44 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44" returned: 0 in 0.658s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-43e741e5-23b1-4355-9e47-43fd3d1689bd req-d22453fe-e9ae-4804-b26b-d662c384c561 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.167s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedba01f-e92f-4539-a0a4-d5f9de4dc5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff039762-139d-4b14-8708-59dc511c5a44', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72040fa-e26c-4e27-b57c-fa38efc85f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e53906d-01fd-46de-9f69-201909a84eb2]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-43e741e5-23b1-4355-9e47-43fd3d1689bd req-d22453fe-e9ae-4804-b26b-d662c384c561 tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:44 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Volume volume-ff039762-139d-4b14-8708-59dc511c5a44 (ff039762-139d-4b14-8708-59dc511c5a44): created successfully Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72040fa-e26c-4e27-b57c-fa38efc85f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Flow 'volume_create_manager' (f852bb9f-5e20-43a4-a98c-b56fb1c57e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0e6041c0-5893-42c8-9bb5-8f3fd39717a3 tempest-VolumesListAdminTestJSON-182919492 None] Created volume successfully. Jul 05 19:46:44 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 Jul 05 19:46:44 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Flow 'volume_create_manager' (e66f29b2-4b40-486f-86c6-d2452fe26a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334f1081-305e-4ee3-ba3b-b11c72de8961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334f1081-305e-4ee3-ba3b-b11c72de8961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1199630266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f703893f-e4c1-4023-8c3b-2389b18d1ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229962be497443fb1b777e50856a244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:45Z,use_quota=True,user_id='83a55311e80f48fe8b1e3179c160ce41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e2c90b-a405-456f-ae9b-e980dc6742c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e2c90b-a405-456f-ae9b-e980dc6742c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e8964a-1d7a-498d-a109-6af03a294b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e8964a-1d7a-498d-a109-6af03a294b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f703893f-e4c1-4023-8c3b-2389b18d1ee4', 'volume_name': 'volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ca6f98-c684-4b4a-9dd5-24ae49fecdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ca6f98-c684-4b4a-9dd5-24ae49fecdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:45 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39820f3-628b-4143-8327-820e1dfb3eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:45 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Volume f703893f-e4c1-4023-8c3b-2389b18d1ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4', 'volume_size': 1} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-43e741e5-23b1-4355-9e47-43fd3d1689bd req-d22453fe-e9ae-4804-b26b-d662c384c561 tempest-AttachVolumeNegativeTest-1801146144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0" returned: 0 in 1.046s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-43e741e5-23b1-4355-9e47-43fd3d1689bd req-d22453fe-e9ae-4804-b26b-d662c384c561 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1199630266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f703893f-e4c1-4023-8c3b-2389b18d1ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229962be497443fb1b777e50856a244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:45Z,use_quota=True,user_id='83a55311e80f48fe8b1e3179c160ce41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Creating volume f703893f-e4c1-4023-8c3b-2389b18d1ee4 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:46:45 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:45 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 1073741824 Jul 05 19:46:45 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-43e741e5-23b1-4355-9e47-43fd3d1689bd req-d22453fe-e9ae-4804-b26b-d662c384c561 tempest-AttachVolumeNegativeTest-1801146144 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-42d53096-748a-4927-ba27-c162b6d028b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c10bebe1-4bd8-4952-8357-221f491a3091', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:46:45 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-4f9305ac-ed98-454c-95e4-797f2812de2a req-12f29ccc-ef03-4735-b2ab-899070bf01e4 tempest-TestMinimumBasicScenario-610054833 None] Terminate volume connection completed successfully. Jul 05 19:46:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-4f9305ac-ed98-454c-95e4-797f2812de2a req-12f29ccc-ef03-4735-b2ab-899070bf01e4 tempest-TestMinimumBasicScenario-610054833 None] Deleting attachment 613c72b3-acd3-47c5-8170-98cbed1e43f8. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:46:45 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-43e741e5-23b1-4355-9e47-43fd3d1689bd req-d22453fe-e9ae-4804-b26b-d662c384c561 tempest-AttachVolumeNegativeTest-1801146144 None] attachment_update completed successfully. Jul 05 19:46:46 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 1073741824" returned: 0 in 1.054s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:46 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 Jul 05 19:46:46 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:47 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4" returned: 0 in 0.706s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39820f3-628b-4143-8327-820e1dfb3eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8fa72e-0ed5-4c62-8886-2c17a1b2d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:47 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Volume volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 (f703893f-e4c1-4023-8c3b-2389b18d1ee4): created successfully Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8fa72e-0ed5-4c62-8886-2c17a1b2d922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Flow 'volume_create_manager' (e66f29b2-4b40-486f-86c6-d2452fe26a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8a090e90-5539-4f77-9ee9-55922fae80b0 tempest-VolumesListAdminTestJSON-182919492 None] Created volume successfully. Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Acquiring lock "cinder-1ba76ae9-32d8-459c-bf59-de5a4673e9f3-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Lock "cinder-1ba76ae9-32d8-459c-bf59-de5a4673e9f3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Acquiring lock "cinder-quobyte-1ba76ae9-32d8-459c-bf59-de5a4673e9f3" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Lock "cinder-quobyte-1ba76ae9-32d8-459c-bf59-de5a4673e9f3" acquired by "delete_volume" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb5cc4d-4b81-4a80-819d-1e90b21bf902]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:46:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:47 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 Jul 05 19:46:47 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:48 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3" returned: 0 in 1.009s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:48 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3 Jul 05 19:46:48 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:46:49 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Flow 'volume_create_manager' (fb4dfd24-1ef1-4e4c-8438-8100ac15e6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d6c204-cf00-49d1-8ffb-0408dd6cc6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ba76ae9-32d8-459c-bf59-de5a4673e9f3" returned: 0 in 0.824s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d6c204-cf00-49d1-8ffb-0408dd6cc6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a4cc59-17ec-47c6-bb83-46871dee6fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c8f15127dd4ab88ac13c6824cd743c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:49Z,use_quota=True,user_id='358a1a2b6bb74baf8f4bc50ae618f910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505b06c6-915b-43d9-b567-acde461bcb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505b06c6-915b-43d9-b567-acde461bcb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd5b471-ec92-447e-903c-ebb86235fc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd5b471-ec92-447e-903c-ebb86235fc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a4cc59-17ec-47c6-bb83-46871dee6fb6', 'volume_name': 'volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902ef1f5-5452-4366-9b78-5f64a5812631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902ef1f5-5452-4366-9b78-5f64a5812631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67a6eb5-6edd-4c67-90ef-65d9fa3ac08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:49 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Volume d9a4cc59-17ec-47c6-bb83-46871dee6fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6', 'volume_size': 1} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a4cc59-17ec-47c6-bb83-46871dee6fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c8f15127dd4ab88ac13c6824cd743c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:46:49Z,use_quota=True,user_id='358a1a2b6bb74baf8f4bc50ae618f910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Creating volume d9a4cc59-17ec-47c6-bb83-46871dee6fb6 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:46:49 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Lock "cinder-quobyte-1ba76ae9-32d8-459c-bf59-de5a4673e9f3" released by "delete_volume" :: held 1.939s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:49 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 1073741824 Jul 05 19:46:49 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Created reservations ['828bde5e-c67b-43c4-b5fc-d14b26fd336b', '18764193-92fd-43b8-8eb7-d63ba0254be7', '9e26087c-f1ad-4c0d-a909-017127bbb4fd', 'b738fd5c-f6a2-46f3-a090-8e0ee08d10c6'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:49 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:46:49 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:49 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-d8840b9a-c9fa-4704-964b-dae3ccb84aa5 tempest-TestShelveInstance-2067324130 None] Terminate volume connection completed successfully. Jul 05 19:46:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-d8840b9a-c9fa-4704-964b-dae3ccb84aa5 tempest-TestShelveInstance-2067324130 None] Deleting attachment 13f019f8-04ae-46e3-b58f-4d379e2e2d58. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:46:50 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.789s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:46:50 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Deleted volume successfully. Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7c13fc23-0d7c-4318-882b-7ebc652372b4 tempest-TestMinimumBasicScenario-610054833 None] Lock "cinder-1ba76ae9-32d8-459c-bf59-de5a4673e9f3-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:50 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 1073741824" returned: 0 in 0.978s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:50 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 Jul 05 19:46:50 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Acquiring lock "cinder-ab87c36f-08e5-4a4c-852c-23e1ceffdb48-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Lock "cinder-ab87c36f-08e5-4a4c-852c-23e1ceffdb48-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Acquiring lock "cinder-quobyte-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Lock "cinder-quobyte-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" acquired by "delete_volume" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bb0b43-304d-468d-8723-b2d054670633]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:46:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:50 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:46:50 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:51 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6" returned: 0 in 0.763s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67a6eb5-6edd-4c67-90ef-65d9fa3ac08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95568972-69d7-4eab-bc99-95ec136d183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:46:51 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Volume volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 (d9a4cc59-17ec-47c6-bb83-46871dee6fb6): created successfully Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95568972-69d7-4eab-bc99-95ec136d183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Flow 'volume_create_manager' (fb4dfd24-1ef1-4e4c-8438-8100ac15e6c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:46:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-51edea9a-f4b3-4b6a-844b-0c63f316ea71 tempest-VolumesListAdminTestJSON-1903810758 None] Created volume successfully. Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Acquiring lock "cinder-d9a4cc59-17ec-47c6-bb83-46871dee6fb6-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "cinder-d9a4cc59-17ec-47c6-bb83-46871dee6fb6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Acquiring lock "cinder-quobyte-d9a4cc59-17ec-47c6-bb83-46871dee6fb6" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "cinder-quobyte-d9a4cc59-17ec-47c6-bb83-46871dee6fb6" acquired by "delete_volume" :: waited 0.052s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1b81bf-b2d4-469c-aaf7-4a9c3abbca69]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "cinder-f703893f-e4c1-4023-8c3b-2389b18d1ee4-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-f703893f-e4c1-4023-8c3b-2389b18d1ee4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:51 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 0 in 1.188s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:51 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 Jul 05 19:46:51 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "cinder-quobyte-f703893f-e4c1-4023-8c3b-2389b18d1ee4" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-quobyte-f703893f-e4c1-4023-8c3b-2389b18d1ee4" acquired by "delete_volume" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:52 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c04b87-9548-4b50-89a4-395211fb966c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:46:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:52 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:46:52 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:52 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 Jul 05 19:46:52 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:52 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-b1929487-d70a-4ec5-b2b6-71f98d878637 req-c5fe9d30-e370-4f45-951c-5e0a109a7b95 tempest-AttachVolumeNegativeTest-1801146144 None] Terminate volume connection completed successfully. Jul 05 19:46:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-b1929487-d70a-4ec5-b2b6-71f98d878637 req-c5fe9d30-e370-4f45-951c-5e0a109a7b95 tempest-AttachVolumeNegativeTest-1801146144 None] Deleting attachment c10bebe1-4bd8-4952-8357-221f491a3091. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:46:53 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 1 in 1.183s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:46:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:53 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48 Jul 05 19:46:53 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:53 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4" returned: 0 in 1.168s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:53 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4 Jul 05 19:46:53 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:53 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6" returned: 0 in 1.585s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:53 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6 Jul 05 19:46:53 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:54 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f703893f-e4c1-4023-8c3b-2389b18d1ee4" returned: 0 in 1.052s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-quobyte-f703893f-e4c1-4023-8c3b-2389b18d1ee4" released by "delete_volume" :: held 2.297s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:54 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" returned: 0 in 1.231s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Lock "cinder-quobyte-ab87c36f-08e5-4a4c-852c-23e1ceffdb48" released by "delete_volume" :: held 3.685s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:54 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d9a4cc59-17ec-47c6-bb83-46871dee6fb6" returned: 0 in 1.008s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "cinder-quobyte-d9a4cc59-17ec-47c6-bb83-46871dee6fb6" released by "delete_volume" :: held 2.697s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Created reservations ['b6df04c7-a1ae-46cb-b61d-ed721f93285d', '00a77aed-9040-4950-bc01-0ad772885a02', 'b600f626-03c7-46b4-b924-130e4eb4eb3d', 'e8b4e352-2df3-440e-a896-947aa31c82e3'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.quota [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Created reservations ['0dd8ebb8-cdf0-4c02-bd90-7cdcbe036a93', '9f11c568-2604-497f-8945-5b7ec827c5fd', '1a10b1ea-e0bc-406d-9bcb-02b4482821df', '3990199a-9657-4a57-b1a8-4aa2efa01ecd'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Created reservations ['3bccf6bc-7ac4-420f-a238-cffd7a77d1be', '62f780c0-ff9c-4570-b9eb-e390b633a199', '0519db46-0c79-4006-b832-32b158bfe8a1', 'b216244f-1726-4e35-996f-29c051dcbfde'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:54 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:46:54 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:54 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:46:54 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:54 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:46:54 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "cinder-ff039762-139d-4b14-8708-59dc511c5a44-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-ff039762-139d-4b14-8708-59dc511c5a44-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:55 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.096s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG cinder.manager [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:46:55 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Deleted volume successfully. Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-96709f1f-f465-4d2b-bc68-3134f1ee83c8 req-e1434baf-8e2a-48e5-9a10-283ffcdb5917 tempest-TestShelveInstance-2067324130 None] Lock "cinder-ab87c36f-08e5-4a4c-852c-23e1ceffdb48-delete_volume" released by "delete_volume" :: held 5.157s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:55 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.216s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "cinder-quobyte-ff039762-139d-4b14-8708-59dc511c5a44" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:55 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Deleted volume successfully. Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-quobyte-ff039762-139d-4b14-8708-59dc511c5a44" acquired by "delete_volume" :: waited 0.042s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f4865f1a-c4a0-4dfb-9cac-8d837ec79dfa tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-f703893f-e4c1-4023-8c3b-2389b18d1ee4-delete_volume" released by "delete_volume" :: held 3.967s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[42221794-2238-441f-be53-fd0f817fb4c9]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:46:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:56 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44 Jul 05 19:46:56 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:56 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.358s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:56 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:46:56 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Deleted volume successfully. Jul 05 19:46:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-459d520e-fe1a-4623-b7dd-d94db7e1e7c0 tempest-VolumesListAdminTestJSON-1903810758 None] Lock "cinder-d9a4cc59-17ec-47c6-bb83-46871dee6fb6-delete_volume" released by "delete_volume" :: held 4.540s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:56 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44" returned: 0 in 0.914s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:56 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44 Jul 05 19:46:56 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:57 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ff039762-139d-4b14-8708-59dc511c5a44" returned: 0 in 1.011s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-quobyte-ff039762-139d-4b14-8708-59dc511c5a44" released by "delete_volume" :: held 1.992s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:57 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Created reservations ['07e81be7-5067-43dc-bb73-f73ffabcfd5b', '4f012f9f-c5f3-4923-bf17-d09d21912d0e', '10a739eb-4562-4c6a-a4d6-cdcb3873e729', 'f36a7872-f31a-4b8e-a086-28e391d94d88'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:46:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:46:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:46:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:46:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:46:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:46:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:58 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:46:58 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:46:58 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 05 19:46:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.886s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:46:58 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:46:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Deleted volume successfully. Jul 05 19:46:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8f2f2242-0f52-4ce3-a722-6498913747d1 tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-ff039762-139d-4b14-8708-59dc511c5a44-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:46:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "cinder-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "cinder-quobyte-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:46:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-quobyte-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:46:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb3b8f8-6cd8-4e59-b990-3541c17f6a1f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:46:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:46:59 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 Jul 05 19:46:59 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:00 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0" returned: 0 in 1.016s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:00 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0 Jul 05 19:47:00 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:01 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0" returned: 0 in 0.833s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-quobyte-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0" released by "delete_volume" :: held 1.907s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:01 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Created reservations ['ba56a2ed-e52c-4977-a17d-ce5f56667079', '487ced19-7133-4546-926f-bbce99d2d863', '7ecff55d-963a-4424-9c44-c1c4dcf158e7', '16e1de7a-e5f9-4b99-b901-c126712936df'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:01 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:47:01 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:02 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.925s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:02 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:47:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Deleted volume successfully. Jul 05 19:47:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ec32af9e-8eca-49db-b84a-34dfb60ee893 tempest-VolumesListAdminTestJSON-182919492 None] Lock "cinder-7d7ba5cb-b2c5-47c2-a2e3-02c86b8355b0-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (a97aa6a9-381f-4a1a-be32-80ba384a63ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c776b29-e89f-4e6e-a7df-aae2a230bbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c776b29-e89f-4e6e-a7df-aae2a230bbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831031975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67125c0d-8399-4c2c-9bbb-fa00d7c743d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:10Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c931ce-3c37-4c02-9631-6c70cf13a895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c931ce-3c37-4c02-9631-6c70cf13a895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daee1001-3a8d-43a9-8d53-797569f85acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daee1001-3a8d-43a9-8d53-797569f85acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67125c0d-8399-4c2c-9bbb-fa00d7c743d2', 'volume_name': 'volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ebb492-fddb-49e4-a983-49b66ba7d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ebb492-fddb-49e4-a983-49b66ba7d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a21a15-86f0-49f0-88d8-97d3ea21b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:10 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume 67125c0d-8399-4c2c-9bbb-fa00d7c743d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2', 'volume_size': 1} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831031975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67125c0d-8399-4c2c-9bbb-fa00d7c743d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:10Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Creating volume 67125c0d-8399-4c2c-9bbb-fa00d7c743d2 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:47:10 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:47:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:10 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 1073741824 Jul 05 19:47:10 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:11 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 1073741824" returned: 0 in 1.227s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:11 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 Jul 05 19:47:11 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:12 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" returned: 0 in 0.880s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:47:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a21a15-86f0-49f0-88d8-97d3ea21b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e6bd0f-11e5-486d-99ac-b0deb6d56b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:12 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 (67125c0d-8399-4c2c-9bbb-fa00d7c743d2): created successfully Jul 05 19:47:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e6bd0f-11e5-486d-99ac-b0deb6d56b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (a97aa6a9-381f-4a1a-be32-80ba384a63ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:12 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d23deb7e-4542-439d-a237-2c22c2296892 tempest-CreateVolumesFromSnapshotTest-39263177 None] Created volume successfully. Jul 05 19:47:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Creating offline snapshot 678ffaa1-6133-41b8-890e-8a0d30e0735e of volume 67125c0d-8399-4c2c-9bbb-fa00d7c743d2 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:47:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c018a5e1-92ef-4492-a157-bdbffbde85e3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:14 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 Jul 05 19:47:14 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Flow 'volume_create_manager' (243ccfd5-26ba-4742-900f-f86d8590371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b8e9f0-7c65-493f-b316-fac53caa6f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b8e9f0-7c65-493f-b316-fac53caa6f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-110954347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12905dad-602b-44d2-8a25-a35270bab52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916ac24cecd34160a8513c8ff8d6bc82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:14Z,use_quota=True,user_id='048a1bb992dd46c39d50df07b4235e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0fcf80-507a-4cac-bc59-f112392d8728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0fcf80-507a-4cac-bc59-f112392d8728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b88de9b-9e6d-49fa-8f53-8ebbf630bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b88de9b-9e6d-49fa-8f53-8ebbf630bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12905dad-602b-44d2-8a25-a35270bab52d', 'volume_name': 'volume-12905dad-602b-44d2-8a25-a35270bab52d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c12f42f-35f5-4ccc-8bdc-2fd213e88ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c12f42f-35f5-4ccc-8bdc-2fd213e88ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3752bb-9945-4eb2-91e7-c3fb3719e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:14 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Volume 12905dad-602b-44d2-8a25-a35270bab52d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12905dad-602b-44d2-8a25-a35270bab52d', 'volume_size': 1} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:14 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" returned: 0 in 0.877s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:14 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e 1G Jul 05 19:47:14 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:15 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e 1G" returned: 0 in 0.886s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:15 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e Jul 05 19:47:15 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:47:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:16 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:47:16 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:16 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e" returned: 0 in 0.896s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:16 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e is being set with open permissions: ugo+rw Jul 05 19:47:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:16 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e Jul 05 19:47:16 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:17 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.833s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:47:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:47:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:47:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:47:17 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e" returned: 0 in 0.932s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:17 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.info Jul 05 19:47:17 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:18 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.info" returned: 0 in 0.690s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:18 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.info is being set with open permissions: ugo+rw Jul 05 19:47:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:18 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.info Jul 05 19:47:18 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:19 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.info" returned: 0 in 0.868s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.289s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.939s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-110954347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12905dad-602b-44d2-8a25-a35270bab52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916ac24cecd34160a8513c8ff8d6bc82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:14Z,use_quota=True,user_id='048a1bb992dd46c39d50df07b4235e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Creating volume 12905dad-602b-44d2-8a25-a35270bab52d {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:47:19 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:47:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:19 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d 1073741824 Jul 05 19:47:19 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:19 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b0b7fa44-39c9-44eb-87d7-b85cc01298e7 tempest-CreateVolumesFromSnapshotTest-39263177 None] Create snapshot completed successfully Jul 05 19:47:20 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d 1073741824" returned: 0 in 1.054s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:20 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d Jul 05 19:47:20 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:20 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:47:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (4870dcd3-00b0-45a7-9ffa-d8c48f688977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1022cd5-a375-439e-94c6-6541dddb5d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1022cd5-a375-439e-94c6-6541dddb5d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994979684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce01fb8-bd0b-4d46-88d9-f3bc76e41845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:21Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58711ba-6c25-41ff-b76e-590302f4033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58711ba-6c25-41ff-b76e-590302f4033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f0cb5e-fd4e-4680-b0d2-26b101a54ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f0cb5e-fd4e-4680-b0d2-26b101a54ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce01fb8-bd0b-4d46-88d9-f3bc76e41845', 'volume_name': 'volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be34cc29-c097-41ee-b3d8-2746031a6bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be34cc29-c097-41ee-b3d8-2746031a6bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d0bd7b-a7fd-4763-8cfe-4bf890b1b2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:21 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume 8ce01fb8-bd0b-4d46-88d9-f3bc76e41845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845', 'volume_size': 1} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:21 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d" returned: 0 in 0.976s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994979684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce01fb8-bd0b-4d46-88d9-f3bc76e41845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:21Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Creating volume 8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:47:21 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3752bb-9945-4eb2-91e7-c3fb3719e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12905dad-602b-44d2-8a25-a35270bab52d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:21 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 1073741824 Jul 05 19:47:21 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf8727b-485c-45a6-8fa2-5d8edca89d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:21 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Volume volume-12905dad-602b-44d2-8a25-a35270bab52d (12905dad-602b-44d2-8a25-a35270bab52d): created successfully Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf8727b-485c-45a6-8fa2-5d8edca89d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Flow 'volume_create_manager' (243ccfd5-26ba-4742-900f-f86d8590371e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:21 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3f0ef352-c855-45cd-90dd-84db7e71c88e tempest-AbsoluteLimitsTests-297274637 None] Created volume successfully. Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (2012e441-5f3d-4d1d-b975-fbd96a5a0874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4628b41d-cadf-464c-b936-12a922fd3657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4628b41d-cadf-464c-b936-12a922fd3657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206268774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4784399b-b0db-467d-a219-2ae27d3f8e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:21Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b21c86-36d0-4a95-9dcb-00beaa99def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b21c86-36d0-4a95-9dcb-00beaa99def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca518805-62ff-483e-878b-8bb939f0db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca518805-62ff-483e-878b-8bb939f0db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4784399b-b0db-467d-a219-2ae27d3f8e60', 'volume_name': 'volume-4784399b-b0db-467d-a219-2ae27d3f8e60', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c173f7db-5624-4015-830a-5bdd0cbb024a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c173f7db-5624-4015-830a-5bdd0cbb024a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5e2742-6e54-42a2-890c-c3155f666b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:21 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume 4784399b-b0db-467d-a219-2ae27d3f8e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4784399b-b0db-467d-a219-2ae27d3f8e60', 'volume_size': 1} Jul 05 19:47:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (95cbe6ca-5816-460c-8186-efaacb1cca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d6224b-0d0a-4444-9a21-148ea49a6587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d6224b-0d0a-4444-9a21-148ea49a6587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145649011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dddd935-d072-4696-85cc-ba1d8b732e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:22Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2c4c20-0c57-492c-9363-8759e2af81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2c4c20-0c57-492c-9363-8759e2af81cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffe8929-5d2b-4adf-b14b-bb831f694af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffe8929-5d2b-4adf-b14b-bb831f694af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dddd935-d072-4696-85cc-ba1d8b732e76', 'volume_name': 'volume-7dddd935-d072-4696-85cc-ba1d8b732e76', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fd0c0d-4ef7-4953-8665-15381d7391dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fd0c0d-4ef7-4953-8665-15381d7391dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f80c539-0442-4742-8398-2c160324570a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume 7dddd935-d072-4696-85cc-ba1d8b732e76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dddd935-d072-4696-85cc-ba1d8b732e76', 'volume_size': 1} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Acquiring lock "cinder-12905dad-602b-44d2-8a25-a35270bab52d-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Lock "cinder-12905dad-602b-44d2-8a25-a35270bab52d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Acquiring lock "cinder-quobyte-12905dad-602b-44d2-8a25-a35270bab52d" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Lock "cinder-quobyte-12905dad-602b-44d2-8a25-a35270bab52d" acquired by "delete_volume" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c1ca8c-5123-49d3-b836-0b63850516aa]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:22 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d Jul 05 19:47:22 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (52e17754-8403-43d5-a314-baa6004ac171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d940fd9-653d-4b0a-af7c-970574efcdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d940fd9-653d-4b0a-af7c-970574efcdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200682620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec4441b-733a-4496-ae7c-5f10bb22966f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:23Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2b1bfb-8d55-47a5-b532-dce09d291f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2b1bfb-8d55-47a5-b532-dce09d291f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30747042-1acc-451f-96d8-ac0a7919f326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30747042-1acc-451f-96d8-ac0a7919f326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec4441b-733a-4496-ae7c-5f10bb22966f', 'volume_name': 'volume-1ec4441b-733a-4496-ae7c-5f10bb22966f', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f41211-26f5-458b-a5b1-5c59f9da558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f41211-26f5-458b-a5b1-5c59f9da558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581ac2fe-4709-4b7f-9dc4-b919b7418f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:22 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume 1ec4441b-733a-4496-ae7c-5f10bb22966f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec4441b-733a-4496-ae7c-5f10bb22966f', 'volume_size': 1} Jul 05 19:47:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:22 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 1073741824" returned: 0 in 1.662s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:23 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 Jul 05 19:47:23 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (566ff816-160e-4f24-ab2f-b7285637d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680727ba-7819-40af-9ffa-01a9482d348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680727ba-7819-40af-9ffa-01a9482d348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-31298512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff1b157-bab2-469e-9ed9-ee15ce61a071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:24Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c4cb7d-c49b-4a88-90c4-8565e95cb6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c4cb7d-c49b-4a88-90c4-8565e95cb6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca5cbe8-c417-492e-8e7c-498556ac3c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca5cbe8-c417-492e-8e7c-498556ac3c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff1b157-bab2-469e-9ed9-ee15ce61a071', 'volume_name': 'volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a74a38f-9f2f-4527-a069-ea164206349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a74a38f-9f2f-4527-a069-ea164206349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454083f1-0976-44c0-90e4-ca82d15bcd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:23 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume 6ff1b157-bab2-469e-9ed9-ee15ce61a071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071', 'volume_size': 1} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:23 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d" returned: 0 in 1.413s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:23 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d Jul 05 19:47:23 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:24 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845" returned: 0 in 1.124s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] <== create_volume: return (2870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.877s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.586s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206268774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4784399b-b0db-467d-a219-2ae27d3f8e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:21Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Creating volume 4784399b-b0db-467d-a219-2ae27d3f8e60 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:47:24 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d0bd7b-a7fd-4763-8cfe-4bf890b1b2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef24137-bd10-4b7a-b717-375caa93b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:24 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60 1073741824 Jul 05 19:47:24 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:24 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 (8ce01fb8-bd0b-4d46-88d9-f3bc76e41845): created successfully Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef24137-bd10-4b7a-b717-375caa93b0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (4870dcd3-00b0-45a7-9ffa-d8c48f688977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7ea0ba5b-afe2-44c3-a9c4-890da5071b06 tempest-CreateVolumesFromSnapshotTest-39263177 None] Created volume successfully. Jul 05 19:47:24 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-12905dad-602b-44d2-8a25-a35270bab52d" returned: 0 in 0.766s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Lock "cinder-quobyte-12905dad-602b-44d2-8a25-a35270bab52d" released by "delete_volume" :: held 2.267s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Created reservations ['ffcf6084-6ffb-4c4d-9fbd-e9257d4f360b', '4474ed05-0b7d-4f1d-bfdb-db96842963fa', '056dd31c-a9cb-49c9-ae40-4cb0ac85402a', '6652a7e1-e6b8-4974-9637-9ae8bd0096b3'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:24 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:47:24 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:25 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60 1073741824" returned: 0 in 1.413s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:25 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60 Jul 05 19:47:25 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:26 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.381s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:47:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Deleted volume successfully. Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-287af07e-7fc1-4b39-9980-1606b8c19990 tempest-AbsoluteLimitsTests-297274637 None] Lock "cinder-12905dad-602b-44d2-8a25-a35270bab52d-delete_volume" released by "delete_volume" :: held 3.912s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:26 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60" returned: 0 in 1.164s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] <== create_volume: return (2691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.695s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.608s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145649011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dddd935-d072-4696-85cc-ba1d8b732e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:22Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Creating volume 7dddd935-d072-4696-85cc-ba1d8b732e76 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:47:26 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:47:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:26 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76 1073741824 Jul 05 19:47:26 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5e2742-6e54-42a2-890c-c3155f666b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4784399b-b0db-467d-a219-2ae27d3f8e60', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50cd006-7722-4649-854f-793bd70d338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:27 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume volume-4784399b-b0db-467d-a219-2ae27d3f8e60 (4784399b-b0db-467d-a219-2ae27d3f8e60): created successfully Jul 05 19:47:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50cd006-7722-4649-854f-793bd70d338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (2012e441-5f3d-4d1d-b975-fbd96a5a0874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:27 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-731e9a10-fb0c-442d-9042-152ccdc294bb tempest-CreateVolumesFromSnapshotTest-39263177 None] Created volume successfully. Jul 05 19:47:28 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76 1073741824" returned: 0 in 1.424s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:28 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76 Jul 05 19:47:28 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:29 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76" returned: 0 in 1.007s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] <== create_volume: return (2477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.462s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200682620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec4441b-733a-4496-ae7c-5f10bb22966f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:23Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Creating volume 1ec4441b-733a-4496-ae7c-5f10bb22966f {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:47:29 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:29 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f 1073741824 Jul 05 19:47:29 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f80c539-0442-4742-8398-2c160324570a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dddd935-d072-4696-85cc-ba1d8b732e76', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70285c54-f804-4122-ade8-b3a66b4545fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:29 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume volume-7dddd935-d072-4696-85cc-ba1d8b732e76 (7dddd935-d072-4696-85cc-ba1d8b732e76): created successfully Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70285c54-f804-4122-ade8-b3a66b4545fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (95cbe6ca-5816-460c-8186-efaacb1cca05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-71953a0d-6972-4523-8e05-f46650dc65ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Created volume successfully. Jul 05 19:47:31 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f 1073741824" returned: 0 in 1.648s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:31 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f Jul 05 19:47:31 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:32 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f" returned: 0 in 1.088s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] <== create_volume: return (2809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.820s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.436s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-31298512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff1b157-bab2-469e-9ed9-ee15ce61a071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9821aeec0243dd878c5e10829978e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:24Z,use_quota=True,user_id='7d61dad6b24e4b3aad72ea40920077eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Creating volume 6ff1b157-bab2-469e-9ed9-ee15ce61a071 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:47:32 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581ac2fe-4709-4b7f-9dc4-b919b7418f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec4441b-733a-4496-ae7c-5f10bb22966f', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2bb8a2-f89f-4d5f-bb72-34a26b0b48da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:32 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 1073741824 Jul 05 19:47:32 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:32 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume volume-1ec4441b-733a-4496-ae7c-5f10bb22966f (1ec4441b-733a-4496-ae7c-5f10bb22966f): created successfully Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2bb8a2-f89f-4d5f-bb72-34a26b0b48da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (52e17754-8403-43d5-a314-baa6004ac171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:32 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-30c30649-ecdf-4d6e-8716-c35be0795f43 tempest-CreateVolumesFromSnapshotTest-39263177 None] Created volume successfully. Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Flow 'volume_create_manager' (4c96b4ad-48bd-4ea8-82f8-a8a3560d24e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb47a6f-97fa-44b8-a8bc-913e7ef05ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb47a6f-97fa-44b8-a8bc-913e7ef05ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2018953067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43336a3-de71-4f6f-a594-e6f895c58c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e854dd133f4c609ca6c661464e5890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:34Z,use_quota=True,user_id='a097e663c5344bb59d87a7056ff28381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42250f77-cf3a-4528-ba96-33664b58a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42250f77-cf3a-4528-ba96-33664b58a28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a53f7d-7647-4476-837e-2d094f159fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a53f7d-7647-4476-837e-2d094f159fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43336a3-de71-4f6f-a594-e6f895c58c69', 'volume_name': 'volume-e43336a3-de71-4f6f-a594-e6f895c58c69', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e64adfb-bf91-4f8e-b59e-14e8246b64c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e64adfb-bf91-4f8e-b59e-14e8246b64c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08db6ae4-4708-4622-afa6-07adda5b4937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:33 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Volume e43336a3-de71-4f6f-a594-e6f895c58c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43336a3-de71-4f6f-a594-e6f895c58c69', 'volume_size': 1} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:33 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 1073741824" returned: 0 in 1.570s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:33 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 Jul 05 19:47:33 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:34 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071" returned: 0 in 1.050s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] <== create_volume: return (2690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.705s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2018953067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43336a3-de71-4f6f-a594-e6f895c58c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e854dd133f4c609ca6c661464e5890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:34Z,use_quota=True,user_id='a097e663c5344bb59d87a7056ff28381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Creating volume e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:47:34 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:47:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454083f1-0976-44c0-90e4-ca82d15bcd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:35 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 1073741824 Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf3cbf6-6362-4fd6-b041-664aa1a1979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:35 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=72,cinder:UPDATE=104,cinder:DELETE=8,cinder:INSERT=23 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:47:35 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Volume volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 (6ff1b157-bab2-469e-9ed9-ee15ce61a071): created successfully Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf3cbf6-6362-4fd6-b041-664aa1a1979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Flow 'volume_create_manager' (566ff816-160e-4f24-ab2f-b7285637d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fb34ac46-a362-4541-bd2d-de35be8e231f tempest-CreateVolumesFromSnapshotTest-39263177 None] Created volume successfully. Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-6ff1b157-bab2-469e-9ed9-ee15ce61a071-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-6ff1b157-bab2-469e-9ed9-ee15ce61a071-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-quobyte-6ff1b157-bab2-469e-9ed9-ee15ce61a071" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-6ff1b157-bab2-469e-9ed9-ee15ce61a071" acquired by "delete_volume" :: waited 0.029s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1bfcb9-bc54-49cf-a574-a388bf529c37]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:35 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 Jul 05 19:47:35 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:36 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 1073741824" returned: 0 in 1.275s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:36 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=88,cinder:SELECT=75,cinder:INSERT=18,cinder:DELETE=12 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:47:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:36 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 Jul 05 19:47:36 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:36 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071" returned: 0 in 1.158s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:36 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071 Jul 05 19:47:36 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:37 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69" returned: 0 in 0.976s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] <== create_volume: return (2346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08db6ae4-4708-4622-afa6-07adda5b4937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43336a3-de71-4f6f-a594-e6f895c58c69', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e890b904-2495-45d6-acb5-a4a920726696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:37 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Volume volume-e43336a3-de71-4f6f-a594-e6f895c58c69 (e43336a3-de71-4f6f-a594-e6f895c58c69): created successfully Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e890b904-2495-45d6-acb5-a4a920726696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Flow 'volume_create_manager' (4c96b4ad-48bd-4ea8-82f8-a8a3560d24e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:37 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-85d76cd5-e926-4308-9695-edab3842c66c tempest-VolumesDeleteCascade-2105649794 None] Created volume successfully. Jul 05 19:47:37 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6ff1b157-bab2-469e-9ed9-ee15ce61a071" returned: 0 in 1.008s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-6ff1b157-bab2-469e-9ed9-ee15ce61a071" released by "delete_volume" :: held 2.268s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Created reservations ['62db3492-77b1-4f9e-86f1-9082797d9fbe', '585becac-b7ee-47d9-9285-a412dc3c1d81', '9f9d94c4-1d63-4ae4-9ee9-ad3638168b4e', 'f0ef9315-87b6-4fd8-a6ab-e8cf6044c040'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:37 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:47:37 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Creating offline snapshot d83569d6-9d9a-4bd1-bf98-b63243bcc269 of volume e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:47:38 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[44754a8a-3ed0-43cc-9531-7d52bb52360d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:38 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 Jul 05 19:47:38 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:38 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-1ec4441b-733a-4496-ae7c-5f10bb22966f-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:38 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-1ec4441b-733a-4496-ae7c-5f10bb22966f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-quobyte-1ec4441b-733a-4496-ae7c-5f10bb22966f" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:39 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.158s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:39 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:47:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-1ec4441b-733a-4496-ae7c-5f10bb22966f" acquired by "delete_volume" :: waited 0.038s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:39 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Deleted volume successfully. Jul 05 19:47:39 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[435ee2a9-403c-47dc-8880-f1f2612bf824]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-03558299-a321-4917-ad75-63f3fda3c642 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-6ff1b157-bab2-469e-9ed9-ee15ce61a071-delete_volume" released by "delete_volume" :: held 3.805s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:39 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f Jul 05 19:47:39 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:39 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69" returned: 0 in 1.102s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:39 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 1G Jul 05 19:47:39 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:40 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f" returned: 0 in 1.243s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:40 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f Jul 05 19:47:40 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:41 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 1G" returned: 0 in 1.638s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e43336a3-de71-4f6f-a594-e6f895c58c69 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:41 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e43336a3-de71-4f6f-a594-e6f895c58c69 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 Jul 05 19:47:41 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:41 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ec4441b-733a-4496-ae7c-5f10bb22966f" returned: 0 in 1.117s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-1ec4441b-733a-4496-ae7c-5f10bb22966f" released by "delete_volume" :: held 2.433s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Created reservations ['beab0202-c372-4280-b518-c0bd93648d44', '5bf70c2f-8fee-4015-a1b2-d6ba239455a1', '178c6c8e-3b9a-44fe-b847-ae2116071fad', '1918f90a-3b82-4b6f-9b12-9a54ab756a93'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:41 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:47:41 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:41 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e43336a3-de71-4f6f-a594-e6f895c58c69 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269" returned: 0 in 0.779s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:41 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 is being set with open permissions: ugo+rw Jul 05 19:47:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:41 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 Jul 05 19:47:41 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-7dddd935-d072-4696-85cc-ba1d8b732e76-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-7dddd935-d072-4696-85cc-ba1d8b732e76-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:42 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.719s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:47:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Deleted volume successfully. Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-quobyte-7dddd935-d072-4696-85cc-ba1d8b732e76" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7944fa7-9e91-4c41-8460-d1f607d29817 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-1ec4441b-733a-4496-ae7c-5f10bb22966f-delete_volume" released by "delete_volume" :: held 3.484s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-7dddd935-d072-4696-85cc-ba1d8b732e76" acquired by "delete_volume" :: waited 0.036s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df0bc8-dc87-42fd-8099-7d0508d3527e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:42 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76 Jul 05 19:47:42 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:42 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269" returned: 0 in 0.789s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:42 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.info Jul 05 19:47:42 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:43 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76" returned: 0 in 0.812s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:43 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76 Jul 05 19:47:43 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:43 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.info" returned: 0 in 0.665s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:43 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.info is being set with open permissions: ugo+rw Jul 05 19:47:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:43 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.info Jul 05 19:47:43 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:44 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7dddd935-d072-4696-85cc-ba1d8b732e76" returned: 0 in 0.733s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-7dddd935-d072-4696-85cc-ba1d8b732e76" released by "delete_volume" :: held 1.596s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Created reservations ['a58208ec-e3dc-4e49-94cf-974e2928c707', '7f829c2e-d5e1-4284-b126-6c13c6ebef8d', '35ef9f61-8d60-4dc9-ae58-999fc2a76f6b', 'b9828f74-2857-4264-85ce-f9aa0334d058'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:44 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.info" returned: 0 in 0.722s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.831s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:44 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:47:44 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-592c4a5c-a522-4a8b-9e7f-8dbe0f85e481 tempest-VolumesDeleteCascade-2105649794 None] Create snapshot completed successfully Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-4784399b-b0db-467d-a219-2ae27d3f8e60-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-4784399b-b0db-467d-a219-2ae27d3f8e60-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-quobyte-4784399b-b0db-467d-a219-2ae27d3f8e60" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-4784399b-b0db-467d-a219-2ae27d3f8e60" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a27ee7-953b-4552-9486-bd8d5fb4dcdd]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:44 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60 Jul 05 19:47:44 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Creating offline snapshot 0f221089-5d51-4bb4-93d0-8dc13d8123c1 of volume e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:47:45 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.865s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[647ce59b-603b-46e9-b137-e9e12df9adfe]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:45 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Deleted volume successfully. Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b24d6888-6bc4-416b-963b-17bcf6a6d908 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-7dddd935-d072-4696-85cc-ba1d8b732e76-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:45 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 Jul 05 19:47:45 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:45 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60" returned: 0 in 0.907s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:45 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60 Jul 05 19:47:45 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:45 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269" returned: 0 in 0.828s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e43336a3-de71-4f6f-a594-e6f895c58c69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:47:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:45 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 1G Jul 05 19:47:45 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:46 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4784399b-b0db-467d-a219-2ae27d3f8e60" returned: 0 in 0.693s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-4784399b-b0db-467d-a219-2ae27d3f8e60" released by "delete_volume" :: held 1.653s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Created reservations ['9188bee5-9a53-4717-8329-b5d7b5d7feac', '19a8c1d8-0aa6-438c-9100-f0eeb68eb84f', 'be2f646a-b16d-4c63-9479-b34353580cc0', '54c58e4b-570b-420d-aaed-01b4ea93baa2'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:46 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:47:46 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:46 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 1G" returned: 0 in 0.938s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:46 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 Jul 05 19:47:46 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-quobyte-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4e228e-3689-4e3d-bfc7-597b9b27a028]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:47 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 Jul 05 19:47:47 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:47 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.803s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:47:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Deleted volume successfully. Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-434544b6-e7f6-4d38-b0aa-9ab50fa45237 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-4784399b-b0db-467d-a219-2ae27d3f8e60-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:47 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1" returned: 0 in 0.805s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:47 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 is being set with open permissions: ugo+rw Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:47 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 Jul 05 19:47:47 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:47 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845" returned: 0 in 0.783s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:47 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845 Jul 05 19:47:47 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:48 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1" returned: 0 in 0.793s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.532s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-76cb6615-2cba-42a1-8694-68b1dc5f8248 tempest-VolumesDeleteCascade-2105649794 None] Create snapshot completed successfully Jul 05 19:47:48 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845" returned: 0 in 0.712s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845" released by "delete_volume" :: held 1.556s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Created reservations ['7445dbaf-e171-4010-b46f-ffef64a868a1', '48b97b5e-050f-4da2-a1b9-0b0e454a0bb8', '5a57af4a-b8bd-4ff0-9197-b1e81d3c8b47', 'a2bd63ab-4f64-41a8-b645-cab34ef46915'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:48 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:47:48 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-678ffaa1-6133-41b8-890e-8a0d30e0735e-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-e43336a3-de71-4f6f-a594-e6f895c58c69-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-678ffaa1-6133-41b8-890e-8a0d30e0735e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-quobyte-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-e43336a3-de71-4f6f-a594-e6f895c58c69-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-quobyte-678ffaa1-6133-41b8-890e-8a0d30e0735e" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-678ffaa1-6133-41b8-890e-8a0d30e0735e" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Deleting offline snapshot 678ffaa1-6133-41b8-890e-8a0d30e0735e of volume 67125c0d-8399-4c2c-9bbb-fa00d7c743d2 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:47:49 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] snapshot_file for this snap is: volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.822s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1e8c9e-693f-4ef3-a294-728f223b5890]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Performing cascade delete. {{(pid=86389) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 05 19:47:49 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Deleted volume successfully. Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-0f221089-5d51-4bb4-93d0-8dc13d8123c1-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-88c5a75e-570a-4aed-aa95-8e0ca99168ca tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-8ce01fb8-bd0b-4d46-88d9-f3bc76e41845-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-0f221089-5d51-4bb4-93d0-8dc13d8123c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-e43336a3-de71-4f6f-a594-e6f895c58c69" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e43336a3-de71-4f6f-a594-e6f895c58c69" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-0f221089-5d51-4bb4-93d0-8dc13d8123c1" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-0f221089-5d51-4bb4-93d0-8dc13d8123c1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Deleting offline snapshot 0f221089-5d51-4bb4-93d0-8dc13d8123c1 of volume e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] snapshot_file for this snap is: volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d073d0-b7a0-41dd-a728-32e854689f8e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:49 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e Jul 05 19:47:49 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:49 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 Jul 05 19:47:49 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:50 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e" returned: 0 in 1.008s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:47:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[169bc123-27f6-48d4-a3f8-0fa6b1fcef3f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:50 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 Jul 05 19:47:50 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:50 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1" returned: 0 in 1.098s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e43336a3-de71-4f6f-a594-e6f895c58c69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:47:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd4ab8b-0172-46eb-8662-930275ea7547]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:51 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 Jul 05 19:47:51 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:51 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" returned: 0 in 0.847s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:51 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e Jul 05 19:47:51 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:51 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269" returned: 0 in 0.996s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e43336a3-de71-4f6f-a594-e6f895c58c69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:47:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:51 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 Jul 05 19:47:51 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:52 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e" returned: 0 in 0.896s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:52 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e Jul 05 19:47:52 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:52 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1" returned: 0 in 0.903s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:47:52 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1 Jul 05 19:47:52 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Flow 'volume_create_manager' (4a872399-5304-4200-a678-ae13eacfb901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce23650-187f-420c-a9ca-e7f114142f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce23650-187f-420c-a9ca-e7f114142f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1258740689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bce967c-d85e-4476-a91d-5ba4326aa3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6a8654a799425c8cd00b033a89b4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:53Z,use_quota=True,user_id='6ba581e0c79b46ee800b2576c2ef5013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28517f23-8c69-45be-be74-c8207764922b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28517f23-8c69-45be-be74-c8207764922b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84e02e8-cb30-42a6-aae0-4eb0d5fcf4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84e02e8-cb30-42a6-aae0-4eb0d5fcf4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bce967c-d85e-4476-a91d-5ba4326aa3e2', 'volume_name': 'volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72660e3a-d57b-49df-81b8-fab40b7dddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72660e3a-d57b-49df-81b8-fab40b7dddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155e3403-497c-482c-b77b-fbba807ad774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:52 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Volume 5bce967c-d85e-4476-a91d-5ba4326aa3e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2', 'volume_size': 1} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1258740689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bce967c-d85e-4476-a91d-5ba4326aa3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6a8654a799425c8cd00b033a89b4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:47:53Z,use_quota=True,user_id='6ba581e0c79b46ee800b2576c2ef5013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Creating volume 5bce967c-d85e-4476-a91d-5ba4326aa3e2 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:47:52 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:47:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:52 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 1073741824 Jul 05 19:47:52 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:53 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2.678ffaa1-6133-41b8-890e-8a0d30e0735e" returned: 0 in 0.790s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-678ffaa1-6133-41b8-890e-8a0d30e0735e" released by "_delete_snapshot" :: held 3.700s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" released by "delete_snapshot" :: held 3.766s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Created reservations ['3c254e4c-d1cc-4c0a-bb0d-ae0d7b4166ed', '7175e148-c013-4e64-95aa-7507da9593b9', '20fa96b2-a1a8-49c6-bd40-fa13384ab30b', '72526a84-32e6-47b5-84e2-1dcfb6c73751'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Delete snapshot completed successfully. Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-694ee0be-30e2-4b15-8791-6582cd9609fe tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-678ffaa1-6133-41b8-890e-8a0d30e0735e-delete_snapshot" released by "delete_snapshot" :: held 3.958s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:53 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.0f221089-5d51-4bb4-93d0-8dc13d8123c1" returned: 0 in 0.711s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-0f221089-5d51-4bb4-93d0-8dc13d8123c1" released by "_delete_snapshot" :: held 3.811s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e43336a3-de71-4f6f-a594-e6f895c58c69" released by "delete_snapshot" :: held 3.840s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Created reservations ['29b41f3c-5a1d-4337-b6d2-d2f8d710c416', 'e0ee70de-7cc4-4bb2-8cd0-e836ef87e5db', '29b10e01-93d8-43af-a8d6-7b8355923d1b', '006474ff-f4f2-4859-a825-f9aebfad9444'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Delete snapshot completed successfully. Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-0f221089-5d51-4bb4-93d0-8dc13d8123c1-delete_snapshot" released by "delete_snapshot" :: held 4.017s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-d83569d6-9d9a-4bd1-bf98-b63243bcc269-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-67125c0d-8399-4c2c-9bbb-fa00d7c743d2-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-d83569d6-9d9a-4bd1-bf98-b63243bcc269-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-67125c0d-8399-4c2c-9bbb-fa00d7c743d2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-e43336a3-de71-4f6f-a594-e6f895c58c69" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e43336a3-de71-4f6f-a594-e6f895c58c69" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-d83569d6-9d9a-4bd1-bf98-b63243bcc269" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "cinder-quobyte-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-d83569d6-9d9a-4bd1-bf98-b63243bcc269" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Deleting offline snapshot d83569d6-9d9a-4bd1-bf98-b63243bcc269 of volume e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] snapshot_file for this snap is: volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" acquired by "delete_volume" :: waited 0.049s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1008977-06da-409e-88fe-91f1bf1b1e2b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d84f84-4914-4924-bc7f-e49d0726681f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:53 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 1073741824" returned: 0 in 1.051s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:54 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 Jul 05 19:47:54 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:54 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 Jul 05 19:47:54 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:54 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 Jul 05 19:47:54 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:54 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269" returned: 0 in 0.788s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e43336a3-de71-4f6f-a594-e6f895c58c69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[da25bfca-abeb-4374-b62f-efd5a5eac245]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:54 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2" returned: 0 in 0.725s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155e3403-497c-482c-b77b-fbba807ad774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87dc795-f918-4b79-b1e7-99398b804612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:47:54 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Volume volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 (5bce967c-d85e-4476-a91d-5ba4326aa3e2): created successfully Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87dc795-f918-4b79-b1e7-99398b804612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Flow 'volume_create_manager' (4a872399-5304-4200-a678-ae13eacfb901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:47:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4497dcfd-7a60-4135-ad54-b87dfc39bbf9 tempest-AttachVolumeNegativeTest-1801146144 None] Created volume successfully. Jul 05 19:47:54 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" returned: 0 in 0.931s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:54 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 Jul 05 19:47:54 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:54 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2 Jul 05 19:47:54 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:55 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69" returned: 0 in 1.005s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:55 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:55 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 Jul 05 19:47:55 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" returned: 0 in 0.904s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-quobyte-67125c0d-8399-4c2c-9bbb-fa00d7c743d2" released by "delete_volume" :: held 1.927s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:55 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Created reservations ['8a08008d-adc3-4eb6-b7d0-aa61a0f140cc', '6cd623df-c11b-49cd-af60-ae88cc325011', 'ec7fe53b-aaef-44a8-be21-b0784b48aea6', '81bd2a83-194f-484f-a23c-bcc5eb56f25b'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:47:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:47:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:47:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:56 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:47:56 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:57 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.120s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:57 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:47:57 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Deleted volume successfully. Jul 05 19:47:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d493ac87-974c-427b-a308-e682dacbb833 tempest-CreateVolumesFromSnapshotTest-39263177 None] Lock "cinder-67125c0d-8399-4c2c-9bbb-fa00d7c743d2-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:57 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269" returned: 0 in 1.490s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:57 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269 Jul 05 19:47:57 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:58 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69.d83569d6-9d9a-4bd1-bf98-b63243bcc269" returned: 0 in 0.842s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-d83569d6-9d9a-4bd1-bf98-b63243bcc269" released by "_delete_snapshot" :: held 4.269s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e43336a3-de71-4f6f-a594-e6f895c58c69" released by "delete_snapshot" :: held 4.300s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Created reservations ['96e56b9e-690e-4528-821f-27d2aaed7a96', '2da42d1c-94d8-4c0b-bf79-d138ee905ab3', '10e088ba-deda-4258-b8a7-d557773416bd', '6ba33e70-008c-4869-9d3b-9dfc167ada1f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:47:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Delete snapshot completed successfully. Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-d83569d6-9d9a-4bd1-bf98-b63243bcc269-delete_snapshot" released by "delete_snapshot" :: held 4.514s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Snapshots deleted, issuing volume delete {{(pid=86389) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-e43336a3-de71-4f6f-a594-e6f895c58c69" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e43336a3-de71-4f6f-a594-e6f895c58c69" acquired by "delete_volume" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2af281-f7c0-4541-8173-3fdef6408f98]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:58 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 Jul 05 19:47:58 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:59 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 05 19:47:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69" returned: 0 in 1.176s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:47:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:59 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69 Jul 05 19:47:59 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:47:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1188146f-0c35-4d96-8599-b073181d5e3e req-80c48c53-1aff-469f-b6a8-ccec6744eadb tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:47:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1188146f-0c35-4d96-8599-b073181d5e3e req-80c48c53-1aff-469f-b6a8-ccec6744eadb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:47:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bda8a7-bbed-41cc-959a-57bab7bbe5fb]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:47:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-1188146f-0c35-4d96-8599-b073181d5e3e req-80c48c53-1aff-469f-b6a8-ccec6744eadb tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:47:59 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 Jul 05 19:47:59 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:00 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e43336a3-de71-4f6f-a594-e6f895c58c69" returned: 0 in 1.089s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e43336a3-de71-4f6f-a594-e6f895c58c69" released by "delete_volume" :: held 2.352s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Flow 'volume_create_manager' (00186c10-fee9-4cad-8cac-a166bd7f2162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d3c567-064d-4cc9-b1db-a13e9beff98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d3c567-064d-4cc9-b1db-a13e9beff98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dce076-76f0-41ab-8684-643ad4058d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dbc60a6c34c21ada153ff1ca12c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:00Z,use_quota=True,user_id='87c1e2f8396a4303aaac8747ac54f6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d803d32-b43f-4ce4-a4b8-df3a7fc24de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d803d32-b43f-4ce4-a4b8-df3a7fc24de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ddb535-c336-4628-bc3f-c24564f963b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ddb535-c336-4628-bc3f-c24564f963b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73dce076-76f0-41ab-8684-643ad4058d98', 'volume_name': 'volume-73dce076-76f0-41ab-8684-643ad4058d98', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38feb8e-5a5d-4198-994f-f27ab6a21abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38feb8e-5a5d-4198-994f-f27ab6a21abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b09bb1-c364-4b13-96f7-4ab20f900214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:00 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Volume 73dce076-76f0-41ab-8684-643ad4058d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73dce076-76f0-41ab-8684-643ad4058d98', 'volume_size': 1} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Created reservations ['5257b1dd-d53c-46f4-b81b-5ad242ca0663', '807b902c-b883-4a1a-954b-4931ad3ad52d', '730c1c4e-b0ed-42e5-9073-315b204fb9cf', 'ae2872aa-74f3-44f8-8d6a-efc9e3269d6f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:00 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:00 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:00 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-1188146f-0c35-4d96-8599-b073181d5e3e req-80c48c53-1aff-469f-b6a8-ccec6744eadb tempest-AttachVolumeNegativeTest-1801146144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2" returned: 0 in 1.366s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1188146f-0c35-4d96-8599-b073181d5e3e req-80c48c53-1aff-469f-b6a8-ccec6744eadb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.393s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dce076-76f0-41ab-8684-643ad4058d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dbc60a6c34c21ada153ff1ca12c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:00Z,use_quota=True,user_id='87c1e2f8396a4303aaac8747ac54f6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Creating volume 73dce076-76f0-41ab-8684-643ad4058d98 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:01 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:01 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98 1073741824 Jul 05 19:48:01 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-1188146f-0c35-4d96-8599-b073181d5e3e req-80c48c53-1aff-469f-b6a8-ccec6744eadb tempest-AttachVolumeNegativeTest-1801146144 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e2ea78e-590f-4598-9020-b7467c607093', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:48:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-1188146f-0c35-4d96-8599-b073181d5e3e req-80c48c53-1aff-469f-b6a8-ccec6744eadb tempest-AttachVolumeNegativeTest-1801146144 None] attachment_update completed successfully. Jul 05 19:48:02 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.134s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Deleted volume successfully. Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8b75174e-65ae-4204-be64-6a874fce58bd tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-e43336a3-de71-4f6f-a594-e6f895c58c69-delete_volume" released by "delete_volume" :: held 12.647s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:02 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98 1073741824" returned: 0 in 1.369s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:02 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98 Jul 05 19:48:02 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Flow 'volume_create_manager' (f9da0941-5586-45b4-b804-c55bab0ae29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83326e2a-e62b-4ecb-b93d-4ed27665c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83326e2a-e62b-4ecb-b93d-4ed27665c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1295821100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3978793c-3870-479d-8699-898dd7101f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e854dd133f4c609ca6c661464e5890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:03Z,use_quota=True,user_id='a097e663c5344bb59d87a7056ff28381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ed9dd4-39aa-45ae-87fb-07137f684e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ed9dd4-39aa-45ae-87fb-07137f684e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c4a7ae-a2f3-42d2-9568-e4787848940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c4a7ae-a2f3-42d2-9568-e4787848940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3978793c-3870-479d-8699-898dd7101f7b', 'volume_name': 'volume-3978793c-3870-479d-8699-898dd7101f7b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3353cd90-03e8-4379-bc93-0827f023131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3353cd90-03e8-4379-bc93-0827f023131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d247585-ccb0-405f-b169-7ba98a3cd139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:02 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Volume 3978793c-3870-479d-8699-898dd7101f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3978793c-3870-479d-8699-898dd7101f7b', 'volume_size': 1} Jul 05 19:48:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:03 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98" returned: 0 in 0.898s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1295821100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3978793c-3870-479d-8699-898dd7101f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e854dd133f4c609ca6c661464e5890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:03Z,use_quota=True,user_id='a097e663c5344bb59d87a7056ff28381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Creating volume 3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:03 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b09bb1-c364-4b13-96f7-4ab20f900214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73dce076-76f0-41ab-8684-643ad4058d98', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:03 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b 1073741824 Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ef4d83-e99b-4c31-bfa9-1ecdf27e2f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:03 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:03 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Volume volume-73dce076-76f0-41ab-8684-643ad4058d98 (73dce076-76f0-41ab-8684-643ad4058d98): created successfully Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ef4d83-e99b-4c31-bfa9-1ecdf27e2f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:03 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Flow 'volume_create_manager' (00186c10-fee9-4cad-8cac-a166bd7f2162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:03 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8014e1ae-9c76-497f-b45b-53fdb553ec7e tempest-CinderUnicodeTest-1188268411 None] Created volume successfully. Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Flow 'volume_create_manager' (acfa1749-983a-4651-8c32-c620b960b2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6682e44-b99c-4d68-9c5f-0d95d06e73a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6682e44-b99c-4d68-9c5f-0d95d06e73a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-88064257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7862eb2e-ae86-491d-bcc5-9ed4c31e84f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dbc60a6c34c21ada153ff1ca12c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:04Z,use_quota=True,user_id='87c1e2f8396a4303aaac8747ac54f6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343de239-6980-483f-b7bb-42fb1c467db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343de239-6980-483f-b7bb-42fb1c467db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba66d68-6390-4342-8331-52b4cb60079d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba66d68-6390-4342-8331-52b4cb60079d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7862eb2e-ae86-491d-bcc5-9ed4c31e84f1', 'volume_name': 'volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:04 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec1a0a1-bc0c-4971-8acc-718ee2af096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec1a0a1-bc0c-4971-8acc-718ee2af096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f466909-924d-4377-b1e0-863857422142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:04 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Volume 7862eb2e-ae86-491d-bcc5-9ed4c31e84f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1', 'volume_size': 1} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b 1073741824" returned: 0 in 1.278s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:04 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b Jul 05 19:48:04 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:05 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b" returned: 0 in 0.681s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-88064257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7862eb2e-ae86-491d-bcc5-9ed4c31e84f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dbc60a6c34c21ada153ff1ca12c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:04Z,use_quota=True,user_id='87c1e2f8396a4303aaac8747ac54f6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Creating volume 7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:05 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d247585-ccb0-405f-b169-7ba98a3cd139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3978793c-3870-479d-8699-898dd7101f7b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f240070-59ef-4f17-8335-2c3658604e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:05 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 1073741824 Jul 05 19:48:05 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:05 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Volume volume-3978793c-3870-479d-8699-898dd7101f7b (3978793c-3870-479d-8699-898dd7101f7b): created successfully Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f240070-59ef-4f17-8335-2c3658604e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Flow 'volume_create_manager' (f9da0941-5586-45b4-b804-c55bab0ae29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:05 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-31f3e3e9-d94a-43ba-9ff5-c07627d78d0a tempest-VolumesDeleteCascade-2105649794 None] Created volume successfully. Jul 05 19:48:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:06 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 1073741824" returned: 0 in 1.224s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:06 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 Jul 05 19:48:06 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:07 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" returned: 0 in 0.801s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.299s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f466909-924d-4377-b1e0-863857422142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9961b3a2-f29d-4645-aeba-c30fc987ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Creating offline snapshot 7a9adbf0-b591-43db-9582-6ccedfc9e798 of volume 3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:48:07 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Volume volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 (7862eb2e-ae86-491d-bcc5-9ed4c31e84f1): created successfully Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9961b3a2-f29d-4645-aeba-c30fc987ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Flow 'volume_create_manager' (acfa1749-983a-4651-8c32-c620b960b2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[76843770-d91b-4ab5-9bf9-a832e05cd0a2]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:07 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-88416716-1576-4590-8390-d0dde4c5b766 tempest-CinderUnicodeTest-1188268411 None] Created volume successfully. Jul 05 19:48:07 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b Jul 05 19:48:07 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:08 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-ae2aa744-6012-4df0-9866-696973bc4f7b req-9a1c01d0-cce8-42e3-a988-038e87c944ad tempest-AttachVolumeNegativeTest-1801146144 None] Terminate volume connection completed successfully. Jul 05 19:48:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-ae2aa744-6012-4df0-9866-696973bc4f7b req-9a1c01d0-cce8-42e3-a988-038e87c944ad tempest-AttachVolumeNegativeTest-1801146144 None] Deleting attachment 0e2ea78e-590f-4598-9020-b7467c607093. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:48:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:08 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b" returned: 0 in 1.124s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:08 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 1G Jul 05 19:48:08 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:09 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 1G" returned: 0 in 0.813s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3978793c-3870-479d-8699-898dd7101f7b -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:09 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3978793c-3870-479d-8699-898dd7101f7b -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 Jul 05 19:48:09 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:10 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3978793c-3870-479d-8699-898dd7101f7b -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798" returned: 0 in 0.732s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:10 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 is being set with open permissions: ugo+rw Jul 05 19:48:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:10 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 Jul 05 19:48:10 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:10 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798" returned: 0 in 0.667s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:10 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.info Jul 05 19:48:10 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:11 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.info" returned: 0 in 0.662s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:11 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.info is being set with open permissions: ugo+rw Jul 05 19:48:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:11 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.info Jul 05 19:48:11 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:12 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.info" returned: 0 in 0.748s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.921s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.134s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Creating offline snapshot a1c476a7-174d-4020-a92d-0f9b0bafb16f of volume 7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:48:12 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5764560-5a31-4c19-a53d-10c82d6ef397]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:12 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0beda629-2624-4429-850d-6eb855668076 tempest-VolumesDeleteCascade-2105649794 None] Create snapshot completed successfully Jul 05 19:48:12 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 Jul 05 19:48:12 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:13 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" returned: 0 in 0.858s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:13 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f 1G Jul 05 19:48:13 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Flow 'volume_create_manager' (1a48bb6e-038b-464f-84e6-9e712af1de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb884614-4d18-48d3-bcae-976218856702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb884614-4d18-48d3-bcae-976218856702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1692921258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05cd66e-b17e-4cfb-aa76-503245ea307d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e854dd133f4c609ca6c661464e5890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a9adbf0-b591-43db-9582-6ccedfc9e798,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:14Z,use_quota=True,user_id='a097e663c5344bb59d87a7056ff28381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb637a31-da29-4ec3-9a45-85bac3669cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb637a31-da29-4ec3-9a45-85bac3669cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3988eb0-c3ce-443f-8914-ee8999904902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3988eb0-c3ce-443f-8914-ee8999904902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e05cd66e-b17e-4cfb-aa76-503245ea307d', 'volume_name': 'volume-e05cd66e-b17e-4cfb-aa76-503245ea307d', 'volume_size': 1, 'snapshot_id': '7a9adbf0-b591-43db-9582-6ccedfc9e798'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0199ab-a045-4f81-a6b7-3e77c8335eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0199ab-a045-4f81-a6b7-3e77c8335eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d21b1ce-55f1-41b0-bb1d-2dbe255d0869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:14 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Volume e05cd66e-b17e-4cfb-aa76-503245ea307d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e05cd66e-b17e-4cfb-aa76-503245ea307d', 'volume_size': 1, 'snapshot_id': '7a9adbf0-b591-43db-9582-6ccedfc9e798'} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:14 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f 1G" returned: 0 in 0.911s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:14 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f Jul 05 19:48:14 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:14 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f" returned: 0 in 0.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:14 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f is being set with open permissions: ugo+rw Jul 05 19:48:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:14 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f Jul 05 19:48:14 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:15 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f" returned: 0 in 0.666s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:15 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.info Jul 05 19:48:15 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:16 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:16 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:16 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.info" returned: 0 in 0.689s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:16 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.info is being set with open permissions: ugo+rw Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:16 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.info Jul 05 19:48:16 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:16 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.668s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:48:16 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.info" returned: 0 in 0.688s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.597s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.863s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-7a9adbf0-b591-43db-9582-6ccedfc9e798-e05cd66e-b17e-4cfb-aa76-503245ea307d" by "_create_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-7a9adbf0-b591-43db-9582-6ccedfc9e798-e05cd66e-b17e-4cfb-aa76-503245ea307d" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Creating volume e05cd66e-b17e-4cfb-aa76-503245ea307d from snapshot 7a9adbf0-b591-43db-9582-6ccedfc9e798 {{(pid=86389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-e05cd66e-b17e-4cfb-aa76-503245ea307d" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-63d3b600-c4d5-4002-ae2d-f1400f62fe7d tempest-CinderUnicodeTest-1188268411 None] Create snapshot completed successfully Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e05cd66e-b17e-4cfb-aa76-503245ea307d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] snapshot: 7a9adbf0-b591-43db-9582-6ccedfc9e798, volume: e05cd66e-b17e-4cfb-aa76-503245ea307d, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9e918f-885f-40f1-b374-a25c815c5b80]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:17 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 Jul 05 19:48:17 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "cinder-a1c476a7-174d-4020-a92d-0f9b0bafb16f-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-a1c476a7-174d-4020-a92d-0f9b0bafb16f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "cinder-quobyte-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-quobyte-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "cinder-quobyte-a1c476a7-174d-4020-a92d-0f9b0bafb16f" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-quobyte-a1c476a7-174d-4020-a92d-0f9b0bafb16f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Deleting offline snapshot a1c476a7-174d-4020-a92d-0f9b0bafb16f of volume 7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] snapshot_file for this snap is: volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f59e4-2a25-444f-8920-01ad4be5dd91]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:17 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f Jul 05 19:48:17 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:17 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798" returned: 0 in 0.831s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3978793c-3870-479d-8699-898dd7101f7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa37045a-1a36-409e-8f1e-3e31cda26daa]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:18 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b Jul 05 19:48:18 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "cinder-5bce967c-d85e-4476-a91d-5ba4326aa3e2-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-5bce967c-d85e-4476-a91d-5ba4326aa3e2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "cinder-quobyte-5bce967c-d85e-4476-a91d-5ba4326aa3e2" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-quobyte-5bce967c-d85e-4476-a91d-5ba4326aa3e2" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af3719a-ef53-435d-96ac-bbb4429a903c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:18 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 Jul 05 19:48:18 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:18 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f" returned: 0 in 1.013s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e48170-c34e-4cdf-92e7-669f4d7c664d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:18 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 Jul 05 19:48:18 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:18 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b" returned: 0 in 1.018s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:48:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:19 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d Jul 05 19:48:19 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:19 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2" returned: 0 in 0.947s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:19 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2 Jul 05 19:48:19 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:19 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" returned: 0 in 0.864s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:19 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f Jul 05 19:48:19 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:20 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5bce967c-d85e-4476-a91d-5ba4326aa3e2" returned: 0 in 0.959s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-quobyte-5bce967c-d85e-4476-a91d-5ba4326aa3e2" released by "delete_volume" :: held 1.991s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:20 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Created reservations ['d01e237f-ce5b-4080-9c7f-1adf14e68bed', '10862e6f-7127-4aeb-a166-0aca79aa175b', '010d33e0-36d0-4ef1-9d10-60b7f88e5452', 'c048b7f7-58e7-4354-a4b7-c8dfeb0f9748'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:21 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:21 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:21 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f" returned: 0 in 2.181s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:21 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f Jul 05 19:48:21 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:22 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.200s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:22 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "cinder-42d53096-748a-4927-ba27-c162b6d028b0-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:22 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Deleted volume successfully. Jul 05 19:48:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-42d53096-748a-4927-ba27-c162b6d028b0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f51f358b-c3bb-41f6-a0f3-532ff4a7a38b tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-5bce967c-d85e-4476-a91d-5ba4326aa3e2-delete_volume" released by "delete_volume" :: held 3.859s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "cinder-quobyte-42d53096-748a-4927-ba27-c162b6d028b0" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-quobyte-42d53096-748a-4927-ba27-c162b6d028b0" acquired by "delete_volume" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa7196a-6d9d-4938-89e5-ffcbe6f9b71a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:22 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 Jul 05 19:48:22 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:23 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1.a1c476a7-174d-4020-a92d-0f9b0bafb16f" returned: 0 in 1.312s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-quobyte-a1c476a7-174d-4020-a92d-0f9b0bafb16f" released by "_delete_snapshot" :: held 5.573s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-quobyte-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" released by "delete_snapshot" :: held 5.614s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:23 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Created reservations ['ed61d376-46e8-42bd-b7e9-7842b70ad6c9', '147b25ff-7c9a-43c8-bc89-5547ea842c90', 'eb88d1bc-a430-4b30-bbe3-ce750447a360', '146828e2-f069-40a7-8d4c-55d5f624d715'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Delete snapshot completed successfully. Jul 05 19:48:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ecc73070-b973-4ded-abf4-eb8042644a1f tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-a1c476a7-174d-4020-a92d-0f9b0bafb16f-delete_snapshot" released by "delete_snapshot" :: held 5.940s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:24 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0" returned: 0 in 1.735s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:24 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0 Jul 05 19:48:24 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "cinder-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "cinder-quobyte-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-quobyte-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" acquired by "delete_volume" :: waited 0.049s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:24 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca828d46-0fec-4b56-a39c-633bf8fd0b91]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:25 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 Jul 05 19:48:25 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:25 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Flow 'volume_create_manager' (65a00d01-18bf-4a47-8bc9-90585718fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356f09a1-b412-4a98-9903-936c94ba8b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d" returned: 0 in 6.530s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356f09a1-b412-4a98-9903-936c94ba8b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2033672674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ef9c51-8861-4f97-8f7f-6c6510eafbe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c52743c341f43099d84c3b2224ff7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:25Z,use_quota=True,user_id='8fb97f3b2e9347a4994347c9bef3cccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0f1bf1-b18d-437e-9e40-025b2b338675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0f1bf1-b18d-437e-9e40-025b2b338675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d442c7e6-350f-4556-b9c6-bf7869044c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d442c7e6-350f-4556-b9c6-bf7869044c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ef9c51-8861-4f97-8f7f-6c6510eafbe5', 'volume_name': 'volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962442d1-1858-421c-ac03-98e564736a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962442d1-1858-421c-ac03-98e564736a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd461fc3-cc46-4d86-b21f-163844fa593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:25 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Volume f2ef9c51-8861-4f97-8f7f-6c6510eafbe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5', 'volume_size': 1} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bc3766-eb81-4fe0-9f90-eea5ce96d6fa]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:25 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-42d53096-748a-4927-ba27-c162b6d028b0" returned: 0 in 1.380s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-quobyte-42d53096-748a-4927-ba27-c162b6d028b0" released by "delete_volume" :: held 3.207s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Created reservations ['fde247ba-01d7-453f-928b-83540d3b20a8', 'd7170951-0f2c-426a-9074-9416b93cada0', 'cd7759ba-add8-430a-a7d9-1940631cd8fe', 'c78bce65-9efc-4f3b-b4dd-4051e444bcc5'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:25 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b Jul 05 19:48:25 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:25 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:25 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "cinder-298d36a3-7ac9-426b-84be-45ab3b136ef1-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-298d36a3-7ac9-426b-84be-45ab3b136ef1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:26 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" returned: 0 in 1.349s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "cinder-quobyte-298d36a3-7ac9-426b-84be-45ab3b136ef1" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:26 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1 Jul 05 19:48:26 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-quobyte-298d36a3-7ac9-426b-84be-45ab3b136ef1" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2a12e8-8e44-4513-a3ac-98d426c4bf28]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:26 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 Jul 05 19:48:26 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:26 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.772s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Deleted volume successfully. Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a58c5156-fd70-4b85-b006-af2703a649bb tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-42d53096-748a-4927-ba27-c162b6d028b0-delete_volume" released by "delete_volume" :: held 4.241s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:26 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b" returned: 0 in 1.068s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:48:26 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Converted 1024.00 MB image at 156.78 MB/s Jul 05 19:48:26 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d is being set with open permissions: ugo+rw Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:26 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d Jul 05 19:48:26 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:26 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" returned: 0 in 0.746s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-quobyte-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1" released by "delete_volume" :: held 2.229s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Created reservations ['44a8a7c2-8ec2-4f29-a172-829929f8d30f', 'c271b968-41be-457e-a77f-14a61135a07d', 'adee0db3-7acd-45b8-a98b-39734ce1cfb0', '77739225-2f22-4c3b-af8d-dbbf07e295ae'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:27 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1" returned: 0 in 0.836s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:27 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:27 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:27 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1 Jul 05 19:48:27 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:27 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d" returned: 0 in 0.709s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e05cd66e-b17e-4cfb-aa76-503245ea307d" released by "_copy_volume_from_snapshot" :: held 10.303s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-7a9adbf0-b591-43db-9582-6ccedfc9e798-e05cd66e-b17e-4cfb-aa76-503245ea307d" released by "_create_volume_from_snapshot" :: held 10.342s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.366s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.804s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2033672674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ef9c51-8861-4f97-8f7f-6c6510eafbe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c52743c341f43099d84c3b2224ff7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:25Z,use_quota=True,user_id='8fb97f3b2e9347a4994347c9bef3cccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Creating volume f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:27 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:27 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 1073741824 Jul 05 19:48:27 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d21b1ce-55f1-41b0-bb1d-2dbe255d0869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05cd66e-b17e-4cfb-aa76-503245ea307d', 'volume_size': 1, 'snapshot_id': '7a9adbf0-b591-43db-9582-6ccedfc9e798'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cd395a-05f0-4894-b33c-12081b0d85e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:27 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Volume volume-e05cd66e-b17e-4cfb-aa76-503245ea307d (e05cd66e-b17e-4cfb-aa76-503245ea307d): created successfully Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cd395a-05f0-4894-b33c-12081b0d85e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Flow 'volume_create_manager' (1a48bb6e-038b-464f-84e6-9e712af1de78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:27 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-aa8ab609-17de-450b-8392-1188c9e12f92 tempest-VolumesDeleteCascade-2105649794 None] Created volume successfully. Jul 05 19:48:27 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.715s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:27 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Deleted volume successfully. Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-aff18473-398d-4446-8ee2-2a74b438f67c tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-7862eb2e-ae86-491d-bcc5-9ed4c31e84f1-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:27 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-298d36a3-7ac9-426b-84be-45ab3b136ef1" returned: 0 in 0.725s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "cinder-73dce076-76f0-41ab-8684-643ad4058d98-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-quobyte-298d36a3-7ac9-426b-84be-45ab3b136ef1" released by "delete_volume" :: held 1.618s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-73dce076-76f0-41ab-8684-643ad4058d98-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "cinder-quobyte-73dce076-76f0-41ab-8684-643ad4058d98" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-quobyte-73dce076-76f0-41ab-8684-643ad4058d98" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Created reservations ['a9cb6065-f52d-4306-81f2-3d952a51dd91', '2d8ade07-474c-4b0a-88be-654177c60a34', '79597a36-187c-4b05-9bb7-bd655fd826dd', 'd455ced9-735b-4942-ba69-179dc895f5f2'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0e2d39-629d-4877-a4aa-4b1fa085300b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:28 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:28 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:28 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98 Jul 05 19:48:28 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:28 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 1073741824" returned: 0 in 0.991s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:28 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 Jul 05 19:48:28 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-3978793c-3870-479d-8699-898dd7101f7b-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-3978793c-3870-479d-8699-898dd7101f7b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Performing cascade delete. {{(pid=86389) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-7a9adbf0-b591-43db-9582-6ccedfc9e798-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-7a9adbf0-b591-43db-9582-6ccedfc9e798-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:28 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.769s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-3978793c-3870-479d-8699-898dd7101f7b" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Deleted volume successfully. Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-3978793c-3870-479d-8699-898dd7101f7b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-7a9adbf0-b591-43db-9582-6ccedfc9e798" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a00bb97-848c-4b72-9c54-fc07702fbde6 tempest-AttachVolumeNegativeTest-1801146144 None] Lock "cinder-298d36a3-7ac9-426b-84be-45ab3b136ef1-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-7a9adbf0-b591-43db-9582-6ccedfc9e798" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Deleting offline snapshot 7a9adbf0-b591-43db-9582-6ccedfc9e798 of volume 3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] snapshot_file for this snap is: volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6e09c-92dc-440f-b7c9-7d9b622bcfe8]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:28 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98" returned: 0 in 1.023s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:28 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98 Jul 05 19:48:28 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:29 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 Jul 05 19:48:29 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:29 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5" returned: 0 in 0.861s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd461fc3-cc46-4d86-b21f-163844fa593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff252854-8ef9-4411-90a1-281cb50265ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:29 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Volume volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 (f2ef9c51-8861-4f97-8f7f-6c6510eafbe5): created successfully Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff252854-8ef9-4411-90a1-281cb50265ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Flow 'volume_create_manager' (65a00d01-18bf-4a47-8bc9-90585718fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4805e8df-84ea-46b3-b717-d62281101cff tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Created volume successfully. Jul 05 19:48:29 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-73dce076-76f0-41ab-8684-643ad4058d98" returned: 0 in 0.774s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-quobyte-73dce076-76f0-41ab-8684-643ad4058d98" released by "delete_volume" :: held 1.863s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:29 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Created reservations ['56c70417-71bb-4cc4-84b5-163585c85408', '539dcd75-d991-4c26-9bc8-617dee8712c6', '510a9bf4-dd81-4e06-a996-5bc32cd3ea72', 'e639d6b9-a3cb-4ed7-b9c3-00101a67b60e'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798" returned: 0 in 0.961s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3978793c-3870-479d-8699-898dd7101f7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb65fd8-d2d2-474b-be36-c52858a73ecb]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:29 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:29 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:29 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b Jul 05 19:48:29 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:30 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.790s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:30 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:30 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Deleted volume successfully. Jul 05 19:48:30 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e0c03a7d-92f2-41ee-b088-0535311272e5 tempest-CinderUnicodeTest-1188268411 None] Lock "cinder-73dce076-76f0-41ab-8684-643ad4058d98-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:30 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b" returned: 0 in 1.059s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:30 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 Jul 05 19:48:30 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:31 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798" returned: 0 in 0.850s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:31 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798 Jul 05 19:48:31 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:32 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b.7a9adbf0-b591-43db-9582-6ccedfc9e798" returned: 0 in 0.842s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-7a9adbf0-b591-43db-9582-6ccedfc9e798" released by "_delete_snapshot" :: held 3.843s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-3978793c-3870-479d-8699-898dd7101f7b" released by "delete_snapshot" :: held 3.881s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Created reservations ['f2243298-314a-4c71-8b5c-17821a23a75c', '72608268-7b02-4299-81ca-e9e95f6645c1', '1a64ebc2-bd41-4311-979d-5a6b4c2d6a34', '1e473ce4-2a08-4b7e-b5cb-18274490c940'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:32 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Delete snapshot completed successfully. Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-7a9adbf0-b591-43db-9582-6ccedfc9e798-delete_snapshot" released by "delete_snapshot" :: held 4.153s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Snapshots deleted, issuing volume delete {{(pid=86389) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-3978793c-3870-479d-8699-898dd7101f7b" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-3978793c-3870-479d-8699-898dd7101f7b" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e38d4a-5aad-46a4-81c9-3cf27f3e1659]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:33 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b Jul 05 19:48:33 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-b9850ff1-8050-4d1d-bae8-2b3635af940b req-ba0a7832-6952-4cc5-a894-0901e5a2a284 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-b9850ff1-8050-4d1d-bae8-2b3635af940b req-ba0a7832-6952-4cc5-a894-0901e5a2a284 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[73636a1d-2fbd-42cf-8f84-ee659a574d4f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-b9850ff1-8050-4d1d-bae8-2b3635af940b req-ba0a7832-6952-4cc5-a894-0901e5a2a284 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:33 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 Jul 05 19:48:33 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:33 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b" returned: 0 in 1.030s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:34 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b Jul 05 19:48:34 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:34 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-b9850ff1-8050-4d1d-bae8-2b3635af940b req-ba0a7832-6952-4cc5-a894-0901e5a2a284 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5" returned: 0 in 1.013s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-b9850ff1-8050-4d1d-bae8-2b3635af940b req-ba0a7832-6952-4cc5-a894-0901e5a2a284 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.045s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-b9850ff1-8050-4d1d-bae8-2b3635af940b req-ba0a7832-6952-4cc5-a894-0901e5a2a284 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11913ef0-6ea0-4745-9d95-17a7a26ccf64', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:48:34 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-b9850ff1-8050-4d1d-bae8-2b3635af940b req-ba0a7832-6952-4cc5-a894-0901e5a2a284 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] attachment_update completed successfully. Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3978793c-3870-479d-8699-898dd7101f7b" returned: 0 in 0.804s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:34 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-3978793c-3870-479d-8699-898dd7101f7b" released by "delete_volume" :: held 1.929s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Created reservations ['a016239a-230b-42a9-b0a5-9a9c650381d6', '82f937f7-0022-4914-976c-d81e41d0d62d', '27a34ec6-b88a-4039-896e-ff79d68065c7', '8412c5c9-9f11-4f96-95fb-d9839fe385b2'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:35 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:35 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Flow 'volume_create_manager' (8682a945-b2c8-4b3a-924a-9beaa5f5bac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275743e5-54ac-4553-a3f7-bcab38459bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275743e5-54ac-4553-a3f7-bcab38459bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1826348402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b44269-14a2-4771-8b2d-917c1c94a356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda32df7c0e34121ac220dd7098483c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:35Z,use_quota=True,user_id='db3b93c65070401592a6ab717be6ef99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a108e817-001e-4199-97f4-ebaf8b6c1175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a108e817-001e-4199-97f4-ebaf8b6c1175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad54b5f8-17c7-4705-99c5-8f42b5e98f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad54b5f8-17c7-4705-99c5-8f42b5e98f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b44269-14a2-4771-8b2d-917c1c94a356', 'volume_name': 'volume-68b44269-14a2-4771-8b2d-917c1c94a356', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58023cd1-3057-494e-a3fd-28bcd7736610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58023cd1-3057-494e-a3fd-28bcd7736610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084237f4-c812-41ba-b9d1-e429a3f8e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:35 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Volume 68b44269-14a2-4771-8b2d-917c1c94a356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b44269-14a2-4771-8b2d-917c1c94a356', 'volume_size': 1} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1826348402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b44269-14a2-4771-8b2d-917c1c94a356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda32df7c0e34121ac220dd7098483c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:35Z,use_quota=True,user_id='db3b93c65070401592a6ab717be6ef99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Creating volume 68b44269-14a2-4771-8b2d-917c1c94a356 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:35 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:35 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356 1073741824 Jul 05 19:48:35 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:35 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.776s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Deleted volume successfully. Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=154,cinder:SELECT=132,cinder:INSERT=37,cinder:DELETE=11 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:48:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-307b1901-ddab-4752-9e9c-70cf0de38635 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-3978793c-3870-479d-8699-898dd7101f7b-delete_volume" released by "delete_volume" :: held 7.217s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-e05cd66e-b17e-4cfb-aa76-503245ea307d-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-e05cd66e-b17e-4cfb-aa76-503245ea307d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:36 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356 1073741824" returned: 0 in 1.057s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "cinder-quobyte-e05cd66e-b17e-4cfb-aa76-503245ea307d" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:36 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356 Jul 05 19:48:36 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e05cd66e-b17e-4cfb-aa76-503245ea307d" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ea6244-b799-4c85-a4de-83835d030ac9]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:36 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d Jul 05 19:48:36 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:36 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356" returned: 0 in 0.660s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=169,cinder:DELETE=13,cinder:SELECT=129,cinder:INSERT=45 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084237f4-c812-41ba-b9d1-e429a3f8e923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b44269-14a2-4771-8b2d-917c1c94a356', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f50e9e9-6894-412b-9e0f-d2b1a3634216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:36 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Volume volume-68b44269-14a2-4771-8b2d-917c1c94a356 (68b44269-14a2-4771-8b2d-917c1c94a356): created successfully Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f50e9e9-6894-412b-9e0f-d2b1a3634216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Flow 'volume_create_manager' (8682a945-b2c8-4b3a-924a-9beaa5f5bac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:36 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-aad38ebd-fe5f-421c-8e9e-a533477b7396 tempest-ProjectReaderTests-422751283 None] Created volume successfully. Jul 05 19:48:37 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d" returned: 0 in 0.869s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:37 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d Jul 05 19:48:37 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Flow 'volume_create_manager' (8be52e42-9a3b-44a3-b4f0-a496c65dd900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f6b777-5842-46fa-bea0-192ccfdbc299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f6b777-5842-46fa-bea0-192ccfdbc299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-826477567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ec446a-9863-475d-b316-0304d4722a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce37b38b55c4af3820cd756115e2ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:37Z,use_quota=True,user_id='f5eaf0cc08ae46bca40126623936cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615f785d-14af-4ed6-81c7-9746bc1eeac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615f785d-14af-4ed6-81c7-9746bc1eeac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3646d3e4-96a3-4eee-a523-ecfa1bba3a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3646d3e4-96a3-4eee-a523-ecfa1bba3a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ec446a-9863-475d-b316-0304d4722a7c', 'volume_name': 'volume-e7ec446a-9863-475d-b316-0304d4722a7c', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa79192-bc68-46b0-88d2-1de65296cc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa79192-bc68-46b0-88d2-1de65296cc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fefd51-19e9-48cb-9db3-d939a77e1369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:37 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Volume e7ec446a-9863-475d-b316-0304d4722a7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ec446a-9863-475d-b316-0304d4722a7c', 'volume_size': 1} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-826477567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ec446a-9863-475d-b316-0304d4722a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce37b38b55c4af3820cd756115e2ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:37Z,use_quota=True,user_id='f5eaf0cc08ae46bca40126623936cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Creating volume e7ec446a-9863-475d-b316-0304d4722a7c {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:37 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:37 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c 1073741824 Jul 05 19:48:37 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Acquiring lock "cinder-68b44269-14a2-4771-8b2d-917c1c94a356-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Lock "cinder-68b44269-14a2-4771-8b2d-917c1c94a356-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Acquiring lock "cinder-quobyte-68b44269-14a2-4771-8b2d-917c1c94a356" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Lock "cinder-quobyte-68b44269-14a2-4771-8b2d-917c1c94a356" acquired by "delete_volume" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffce84d-8172-4942-bfc6-a0f96c15ae73]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:37 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356 Jul 05 19:48:37 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:37 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e05cd66e-b17e-4cfb-aa76-503245ea307d" returned: 0 in 0.744s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-quobyte-e05cd66e-b17e-4cfb-aa76-503245ea307d" released by "delete_volume" :: held 1.664s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Created reservations ['bc1c570b-14db-4120-a75c-57be36c8397e', 'cc2ad155-aff4-4183-994e-53858850c905', '7cd39ca7-4a54-464a-9277-eb906ee6451a', '405dcf67-90f5-40f1-a0fd-9a7131cd5d42'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:38 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:38 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:38 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c 1073741824" returned: 0 in 1.018s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:38 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356" returned: 0 in 0.883s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:38 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356 Jul 05 19:48:38 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:38 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c Jul 05 19:48:38 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:38 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.795s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:38 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Deleted volume successfully. Jul 05 19:48:38 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-db78d80a-4333-4ce8-80ea-083f513eb524 tempest-VolumesDeleteCascade-2105649794 None] Lock "cinder-e05cd66e-b17e-4cfb-aa76-503245ea307d-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:39 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-68b44269-14a2-4771-8b2d-917c1c94a356" returned: 0 in 0.796s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Lock "cinder-quobyte-68b44269-14a2-4771-8b2d-917c1c94a356" released by "delete_volume" :: held 1.729s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:39 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c" returned: 0 in 0.810s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fefd51-19e9-48cb-9db3-d939a77e1369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ec446a-9863-475d-b316-0304d4722a7c', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca933890-4b3c-44d2-8d74-4ce46a46ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:39 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Volume volume-e7ec446a-9863-475d-b316-0304d4722a7c (e7ec446a-9863-475d-b316-0304d4722a7c): created successfully Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca933890-4b3c-44d2-8d74-4ce46a46ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Flow 'volume_create_manager' (8be52e42-9a3b-44a3-b4f0-a496c65dd900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:39 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-f3728908-40ee-46c6-ada6-5d2bc6bc97b4 req-bc7634db-7a47-4343-b2d7-b44055d26c96 tempest-VolumesSnapshotsTestJSON-353520586 None] Created volume successfully. Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Created reservations ['9461fef1-b3fa-45b6-9fc7-b06d0df14434', 'd992c2d2-20f7-4bd3-87ad-97ddf33635f7', 'ff1a3c43-2179-4a3e-bb80-c7fea913facc', 'a7fa3308-54f5-4b9b-b04f-79b000aee178'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:39 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:39 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Creating offline snapshot b55f7a03-5a81-4319-a52c-9d7fa658caf9 of volume e7ec446a-9863-475d-b316-0304d4722a7c {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[848db9c0-2c01-4497-88c5-cd1b4bde718e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:40 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c Jul 05 19:48:40 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:40 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.993s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:40 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Deleted volume successfully. Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ba21b7a3-fa1e-40f7-9b79-16a40a235111 tempest-ProjectReaderTests-422751283 None] Lock "cinder-68b44269-14a2-4771-8b2d-917c1c94a356-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Flow 'volume_create_manager' (56900765-4533-4eb2-83b7-a913819faaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9332983c-c4d4-46ce-8a79-01c7f0470a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9332983c-c4d4-46ce-8a79-01c7f0470a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794906151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7de1abd-69bf-4854-9e0c-8ad66e99150b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda32df7c0e34121ac220dd7098483c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:41Z,use_quota=True,user_id='db3b93c65070401592a6ab717be6ef99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ab4586-eecb-42d5-a002-808cec9508b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ab4586-eecb-42d5-a002-808cec9508b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0851758-cbd8-4513-8f6f-e5287e4f1c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0851758-cbd8-4513-8f6f-e5287e4f1c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7de1abd-69bf-4854-9e0c-8ad66e99150b', 'volume_name': 'volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f17246b-e094-4329-bee8-bdb99e6f7602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f17246b-e094-4329-bee8-bdb99e6f7602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8214eb88-f52d-41b3-864e-84f0dc44e0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:40 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Volume d7de1abd-69bf-4854-9e0c-8ad66e99150b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b', 'volume_size': 1} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:40 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c" returned: 0 in 1.093s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:40 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 1G Jul 05 19:48:40 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:41 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 1G" returned: 0 in 0.838s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ec446a-9863-475d-b316-0304d4722a7c -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:41 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ec446a-9863-475d-b316-0304d4722a7c -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 Jul 05 19:48:41 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-036c43e8-6e91-4e8b-af22-408c339c13c1 req-38ee9fe4-239f-4a0e-9218-1657d53168ed tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Terminate volume connection completed successfully. Jul 05 19:48:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-036c43e8-6e91-4e8b-af22-408c339c13c1 req-38ee9fe4-239f-4a0e-9218-1657d53168ed tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Deleting attachment 11913ef0-6ea0-4745-9d95-17a7a26ccf64. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:48:42 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ec446a-9863-475d-b316-0304d4722a7c -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9" returned: 0 in 0.758s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:42 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 is being set with open permissions: ugo+rw Jul 05 19:48:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:42 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 Jul 05 19:48:42 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:43 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9" returned: 0 in 0.669s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:43 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.info Jul 05 19:48:43 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Flow 'volume_create_manager' (9786beac-f5f3-40b8-a7f4-f074a532c648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a427d35b-bba1-467d-a243-f0f9ba2d4286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a427d35b-bba1-467d-a243-f0f9ba2d4286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-796007961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2ed782-c399-4509-8a68-d7fdb5604420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205942fb0975435185abaeadda98fc99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:44Z,use_quota=True,user_id='3c94029792984bcaa830f69f7c17fb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7e31e2-4676-4782-8865-1b33f05c95ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7e31e2-4676-4782-8865-1b33f05c95ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f8adc2-41a7-457f-92e2-fbcaecc7eb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f8adc2-41a7-457f-92e2-fbcaecc7eb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2ed782-c399-4509-8a68-d7fdb5604420', 'volume_name': 'volume-6f2ed782-c399-4509-8a68-d7fdb5604420', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4823c7-0848-4932-a3c4-d0f93d16dbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4823c7-0848-4932-a3c4-d0f93d16dbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00498e9d-064c-4d42-9127-f7921ea4392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:43 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Volume 6f2ed782-c399-4509-8a68-d7fdb5604420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2ed782-c399-4509-8a68-d7fdb5604420', 'volume_size': 1} Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:43 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.info" returned: 0 in 0.676s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:43 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.info is being set with open permissions: ugo+rw Jul 05 19:48:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:43 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.info Jul 05 19:48:43 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Acquiring lock "cinder-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "cinder-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Acquiring lock "cinder-quobyte-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:44 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.info" returned: 0 in 0.670s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.825s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "cinder-quobyte-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.825s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794906151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7de1abd-69bf-4854-9e0c-8ad66e99150b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda32df7c0e34121ac220dd7098483c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:41Z,use_quota=True,user_id='db3b93c65070401592a6ab717be6ef99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Creating volume d7de1abd-69bf-4854-9e0c-8ad66e99150b {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:44 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f8a9ed-6e9d-4e9e-8f18-e9f37a983bd4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:44 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b 1073741824 Jul 05 19:48:44 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-f1e82db2-ac4b-4f50-9562-5a1b91976516 req-4312288a-d0a8-4208-bcde-8a8af58ec586 tempest-VolumesSnapshotsTestJSON-353520586 None] Create snapshot completed successfully Jul 05 19:48:44 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 Jul 05 19:48:44 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Acquiring lock "cinder-b55f7a03-5a81-4319-a52c-9d7fa658caf9-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-b55f7a03-5a81-4319-a52c-9d7fa658caf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Acquiring lock "cinder-quobyte-e7ec446a-9863-475d-b316-0304d4722a7c" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-quobyte-e7ec446a-9863-475d-b316-0304d4722a7c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Acquiring lock "cinder-quobyte-b55f7a03-5a81-4319-a52c-9d7fa658caf9" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-quobyte-b55f7a03-5a81-4319-a52c-9d7fa658caf9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Deleting offline snapshot b55f7a03-5a81-4319-a52c-9d7fa658caf9 of volume e7ec446a-9863-475d-b316-0304d4722a7c {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] snapshot_file for this snap is: volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0447842-5f14-4b0b-9134-39526c406006]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:45 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 Jul 05 19:48:45 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:45 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b 1073741824" returned: 0 in 0.880s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:45 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5" returned: 0 in 0.873s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:45 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5 Jul 05 19:48:45 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:45 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b Jul 05 19:48:45 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:45 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9" returned: 0 in 0.822s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7ec446a-9863-475d-b316-0304d4722a7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c8d24e-02b8-44b5-8ccf-0d29eb993fd8]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:46 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c Jul 05 19:48:46 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:46 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5" returned: 0 in 0.740s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "cinder-quobyte-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5" released by "delete_volume" :: held 1.671s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:46 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b" returned: 0 in 0.734s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.475s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-796007961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2ed782-c399-4509-8a68-d7fdb5604420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205942fb0975435185abaeadda98fc99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:44Z,use_quota=True,user_id='3c94029792984bcaa830f69f7c17fb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Creating volume 6f2ed782-c399-4509-8a68-d7fdb5604420 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:46 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:46 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420 1073741824 Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8214eb88-f52d-41b3-864e-84f0dc44e0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:46 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5511aac-abb9-485a-8f1c-3e05a01a5762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:46 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Volume volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b (d7de1abd-69bf-4854-9e0c-8ad66e99150b): created successfully Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5511aac-abb9-485a-8f1c-3e05a01a5762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Flow 'volume_create_manager' (56900765-4533-4eb2-83b7-a913819faaf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Created reservations ['f1a3af12-3c9f-4b74-92ef-b45a0b872ecd', '8b6a1985-8d7f-475f-9067-636dd37a96e0', 'c07c6eb7-4300-4bf8-91f7-901db158e026', '486da505-61d2-482d-97d6-85d0e707ceec'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3776f550-8cf9-4346-b4d8-38a2e7790419 tempest-ProjectReaderTests-422751283 None] Created volume successfully. Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:46 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:46 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:46 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c" returned: 0 in 0.800s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:46 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 Jul 05 19:48:46 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Acquiring lock "cinder-d7de1abd-69bf-4854-9e0c-8ad66e99150b-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Lock "cinder-d7de1abd-69bf-4854-9e0c-8ad66e99150b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Acquiring lock "cinder-quobyte-d7de1abd-69bf-4854-9e0c-8ad66e99150b" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Lock "cinder-quobyte-d7de1abd-69bf-4854-9e0c-8ad66e99150b" acquired by "delete_volume" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffadd215-c593-495d-a495-8eea433dde5e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:47 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b Jul 05 19:48:47 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:47 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420 1073741824" returned: 0 in 1.161s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:47 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.003s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Deleted volume successfully. Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed44f962-2f77-49a1-b0d0-dc24f00de249 tempest-TestServerVolumeAttachScenarioOldVersion-1808120236 None] Lock "cinder-f2ef9c51-8861-4f97-8f7f-6c6510eafbe5-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:47 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420 Jul 05 19:48:47 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:47 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9" returned: 0 in 1.039s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:47 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9 Jul 05 19:48:47 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:48 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b" returned: 0 in 0.908s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:48 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b Jul 05 19:48:48 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:48 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420" returned: 0 in 0.776s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00498e9d-064c-4d42-9127-f7921ea4392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2ed782-c399-4509-8a68-d7fdb5604420', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143748b8-d1d0-4b69-946a-869ce9e985d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:48 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Volume volume-6f2ed782-c399-4509-8a68-d7fdb5604420 (6f2ed782-c399-4509-8a68-d7fdb5604420): created successfully Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143748b8-d1d0-4b69-946a-869ce9e985d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Flow 'volume_create_manager' (9786beac-f5f3-40b8-a7f4-f074a532c648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-01a536fc-c904-43cc-8f21-62a605b4dc37 tempest-VolumesTransfersV355Test-1745716969 None] Created volume successfully. Jul 05 19:48:48 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c.b55f7a03-5a81-4319-a52c-9d7fa658caf9" returned: 0 in 0.727s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-quobyte-b55f7a03-5a81-4319-a52c-9d7fa658caf9" released by "_delete_snapshot" :: held 3.514s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-quobyte-e7ec446a-9863-475d-b316-0304d4722a7c" released by "delete_snapshot" :: held 3.543s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG cinder.quota [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Created reservations ['8399140c-33dc-4970-8623-ea293035be26', '5942e3ec-19f5-42db-bdcf-4fb0a7b1deec', 'c796fade-a39a-4422-87bf-96d2603df02a', '2bfc2d5f-9d69-4d6b-ad27-da8a46c64ec3'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Delete snapshot completed successfully. Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-5a43d512-6b4b-422b-bc79-0cefc579a4ae req-063ccd1b-7172-4f43-bdf6-e0cf805339a9 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-b55f7a03-5a81-4319-a52c-9d7fa658caf9-delete_snapshot" released by "delete_snapshot" :: held 3.724s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:48 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d7de1abd-69bf-4854-9e0c-8ad66e99150b" returned: 0 in 0.786s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Lock "cinder-quobyte-d7de1abd-69bf-4854-9e0c-8ad66e99150b" released by "delete_volume" :: held 1.755s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Created reservations ['e335b3aa-5339-4788-8a35-f34eedd39ce5', '4435f561-af7e-4b7f-be61-37f467daa5c9', '25eb39e0-63ff-4fe9-80be-0829de6b5050', 'b905089f-0e58-4750-9df7-1c2f650c3317'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:49 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:49 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Acquiring lock "cinder-e7ec446a-9863-475d-b316-0304d4722a7c-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-e7ec446a-9863-475d-b316-0304d4722a7c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Acquiring lock "cinder-quobyte-e7ec446a-9863-475d-b316-0304d4722a7c" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-quobyte-e7ec446a-9863-475d-b316-0304d4722a7c" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[121628d6-895a-4d11-b825-bab9e2776d0d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:49 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c Jul 05 19:48:49 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:50 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3def5aad-5c55-48fd-91c1-6c50e8e008b2 tempest-VolumesTransfersV355Test-1712631956 None] Transfer volume completed successfully. Jul 05 19:48:50 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.192s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:50 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:50 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Deleted volume successfully. Jul 05 19:48:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6eb2f476-7a41-4bdf-983d-a6a3576a8876 tempest-ProjectReaderTests-422751283 None] Lock "cinder-d7de1abd-69bf-4854-9e0c-8ad66e99150b-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:50 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c" returned: 0 in 1.047s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:50 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c Jul 05 19:48:50 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Acquiring lock "cinder-6f2ed782-c399-4509-8a68-d7fdb5604420-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Lock "cinder-6f2ed782-c399-4509-8a68-d7fdb5604420-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Acquiring lock "cinder-quobyte-6f2ed782-c399-4509-8a68-d7fdb5604420" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:51 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e7ec446a-9863-475d-b316-0304d4722a7c" returned: 0 in 0.787s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Lock "cinder-quobyte-6f2ed782-c399-4509-8a68-d7fdb5604420" acquired by "delete_volume" :: waited 0.029s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-quobyte-e7ec446a-9863-475d-b316-0304d4722a7c" released by "delete_volume" :: held 1.946s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e9f8ec-6db8-4bc8-b696-87f1ca850e07]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG cinder.quota [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Created reservations ['c6086902-10e2-4abe-9b8c-11350aa5465c', 'f36848c5-d818-43d1-915b-54411f121b91', '32903b0a-ed58-463a-885b-5d9cc8f21ac1', '15ff6966-443a-44a9-b89f-a2cff603a294'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:51 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420 Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:51 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:51 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:51 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:52 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.785s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:52 devstack cinder-volume[86389]: DEBUG cinder.manager [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:52 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Deleted volume successfully. Jul 05 19:48:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-c49bb51b-cae9-41c1-8009-267a9a72d42f req-57181c00-aa28-44b0-8d38-53b24708dae0 tempest-VolumesSnapshotsTestJSON-353520586 None] Lock "cinder-e7ec446a-9863-475d-b316-0304d4722a7c-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:52 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420" returned: 0 in 1.108s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:52 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420 Jul 05 19:48:52 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:53 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6f2ed782-c399-4509-8a68-d7fdb5604420" returned: 0 in 0.753s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Lock "cinder-quobyte-6f2ed782-c399-4509-8a68-d7fdb5604420" released by "delete_volume" :: held 1.918s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:53 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Created reservations ['d57beb55-4be2-4fe8-996a-3e77b0aa4893', '9d7caa6e-ccc8-4cc5-af98-65974136efd4', 'd6c3dbd1-c91f-4267-b1f0-2adaddace7b9', 'a8ccfa19-9635-4600-b94c-f16d3dbc1117'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:53 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:53 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Flow 'volume_create_manager' (655d3b5d-63eb-4525-805b-5c776d0c1922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b1e9c0-6bc0-42d7-a542-7439cdc51901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b1e9c0-6bc0-42d7-a542-7439cdc51901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-736192916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf11513-ce07-4fcd-ab32-657ea9165a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205942fb0975435185abaeadda98fc99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:54Z,use_quota=True,user_id='3c94029792984bcaa830f69f7c17fb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d64756-fe41-4834-bffe-8f794d78702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d64756-fe41-4834-bffe-8f794d78702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189e90df-d12f-4e26-986d-707538ddf2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189e90df-d12f-4e26-986d-707538ddf2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf11513-ce07-4fcd-ab32-657ea9165a75', 'volume_name': 'volume-eaf11513-ce07-4fcd-ab32-657ea9165a75', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd1564d-28cf-4f6d-8582-5620f4970544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd1564d-28cf-4f6d-8582-5620f4970544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:54 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8791c5-d951-44da-ae94-0a67ceef4131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:54 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Volume eaf11513-ce07-4fcd-ab32-657ea9165a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf11513-ce07-4fcd-ab32-657ea9165a75', 'volume_size': 1} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-736192916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf11513-ce07-4fcd-ab32-657ea9165a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205942fb0975435185abaeadda98fc99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:54Z,use_quota=True,user_id='3c94029792984bcaa830f69f7c17fb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Creating volume eaf11513-ce07-4fcd-ab32-657ea9165a75 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:54 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.996s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:48:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Deleted volume successfully. Jul 05 19:48:54 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 1073741824 Jul 05 19:48:54 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-620cc71a-ce82-4d53-a8e3-f77471db63fe tempest-VolumesTransfersV355Test-1668988718 None] Lock "cinder-6f2ed782-c399-4509-8a68-d7fdb5604420-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Flow 'volume_create_manager' (7fac58e8-823b-4080-b484-62ca5beac9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce849faa-2fd0-4042-85a9-b6040c7d81fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce849faa-2fd0-4042-85a9-b6040c7d81fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446863330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bdada6-e8e9-4fb9-99da-5c9f0d725ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c34e551744a0caab648aa047fdbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:55Z,use_quota=True,user_id='dd94246fa99146b5b18f6ddc2f9dd07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c744d9ac-ddac-4f57-8650-c3e78e718ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c744d9ac-ddac-4f57-8650-c3e78e718ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813462b7-b550-4ffa-bcba-0621f1977efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813462b7-b550-4ffa-bcba-0621f1977efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47bdada6-e8e9-4fb9-99da-5c9f0d725ffa', 'volume_name': 'volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e442ecc2-e475-4945-829e-8211236d6658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e442ecc2-e475-4945-829e-8211236d6658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db20d3c7-42b8-4d1f-b350-7e02276bfbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:55 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Volume 47bdada6-e8e9-4fb9-99da-5c9f0d725ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa', 'volume_size': 1} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:55 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 1073741824" returned: 0 in 1.040s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:55 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 Jul 05 19:48:55 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:56 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75" returned: 0 in 0.696s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446863330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bdada6-e8e9-4fb9-99da-5c9f0d725ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c34e551744a0caab648aa047fdbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:55Z,use_quota=True,user_id='dd94246fa99146b5b18f6ddc2f9dd07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Creating volume 47bdada6-e8e9-4fb9-99da-5c9f0d725ffa {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:56 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:56 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa 1073741824 Jul 05 19:48:56 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8791c5-d951-44da-ae94-0a67ceef4131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf11513-ce07-4fcd-ab32-657ea9165a75', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345b3311-7406-4b98-9da5-0cd5df7333f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:56 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Volume volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 (eaf11513-ce07-4fcd-ab32-657ea9165a75): created successfully Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345b3311-7406-4b98-9da5-0cd5df7333f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Flow 'volume_create_manager' (655d3b5d-63eb-4525-805b-5c776d0c1922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:56 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f61fca15-9f8c-4eb5-83da-5c038658010a tempest-VolumesTransfersV355Test-1745716969 None] Created volume successfully. Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Flow 'volume_create_manager' (93962d87-9dff-4ddd-989b-cbc415d7fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c0fcaa-81e5-4343-8052-91899d2bbf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Acquiring lock "cinder-eaf11513-ce07-4fcd-ab32-657ea9165a75-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c0fcaa-81e5-4343-8052-91899d2bbf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1061098851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f768842-229d-4836-b0db-a11f9d792655,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='229f98389dd646be808c224548a4dbdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:57Z,use_quota=True,user_id='6f929a47c8e04a9596edee952645cc77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e614f717-b1c8-47a2-8ff6-27937b5a477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e614f717-b1c8-47a2-8ff6-27937b5a477d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb6872b-9d33-436b-81e3-9e5dbe7c843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb6872b-9d33-436b-81e3-9e5dbe7c843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f768842-229d-4836-b0db-a11f9d792655', 'volume_name': 'volume-2f768842-229d-4836-b0db-a11f9d792655', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f1ae4c-e978-461d-9ac9-0f21a623ae59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f1ae4c-e978-461d-9ac9-0f21a623ae59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f73eb0-7c90-4bfd-a3eb-1bd5807e02c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:57 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Volume 2f768842-229d-4836-b0db-a11f9d792655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f768842-229d-4836-b0db-a11f9d792655', 'volume_size': 1} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Lock "cinder-eaf11513-ce07-4fcd-ab32-657ea9165a75-delete_volume" acquired by "delete_volume" :: waited 0.167s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Acquiring lock "cinder-quobyte-eaf11513-ce07-4fcd-ab32-657ea9165a75" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Lock "cinder-quobyte-eaf11513-ce07-4fcd-ab32-657ea9165a75" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9317d-c452-46ad-a34e-c2e5f1ff5351]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:57 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa 1073741824" returned: 0 in 1.118s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:57 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 Jul 05 19:48:57 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:57 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa Jul 05 19:48:57 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:58 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75" returned: 0 in 0.878s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:58 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa" returned: 0 in 0.726s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:58 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75 Jul 05 19:48:58 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.091s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1061098851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f768842-229d-4836-b0db-a11f9d792655,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='229f98389dd646be808c224548a4dbdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:48:57Z,use_quota=True,user_id='6f929a47c8e04a9596edee952645cc77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Creating volume 2f768842-229d-4836-b0db-a11f9d792655 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:48:58 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:58 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655 1073741824 Jul 05 19:48:58 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db20d3c7-42b8-4d1f-b350-7e02276bfbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a8ac5e-7615-48d7-a5a5-a09653d76bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:48:58 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Volume volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa (47bdada6-e8e9-4fb9-99da-5c9f0d725ffa): created successfully Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a8ac5e-7615-48d7-a5a5-a09653d76bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Flow 'volume_create_manager' (7fac58e8-823b-4080-b484-62ca5beac9b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:48:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d6c68349-d45d-4fee-9569-3f2b6a3b2e00 tempest-ProjectReaderTests-1575227742 None] Created volume successfully. Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "cinder-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "cinder-quobyte-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-quobyte-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa" acquired by "delete_volume" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9990bb-71d7-467b-bee6-3ee89f81ff6b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:48:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:59 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-eaf11513-ce07-4fcd-ab32-657ea9165a75" returned: 0 in 0.828s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Lock "cinder-quobyte-eaf11513-ce07-4fcd-ab32-657ea9165a75" released by "delete_volume" :: held 1.770s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:48:59 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa Jul 05 19:48:59 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Created reservations ['d321293c-0391-4979-9783-4388d228b902', 'f44284b9-f081-4938-b320-38f06de3bd5a', 'bbf3bc6d-b61e-41a8-b763-e0f420d0cbf3', '8ca2a402-d691-43b6-82c4-f23a7d74bc58'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:59 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:48:59 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:48:59 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655 1073741824" returned: 0 in 1.383s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:48:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:48:59 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655 Jul 05 19:48:59 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:00 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa" returned: 0 in 1.234s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:00 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa Jul 05 19:49:00 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:00 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.035s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:00 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Deleted volume successfully. Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0fb4d167-2cbc-42fc-a8a0-ecd73cde97b3 tempest-VolumesTransfersV355Test-1668988718 None] Lock "cinder-eaf11513-ce07-4fcd-ab32-657ea9165a75-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:00 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655" returned: 0 in 0.928s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] <== create_volume: return (2368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.373s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f73eb0-7c90-4bfd-a3eb-1bd5807e02c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f768842-229d-4836-b0db-a11f9d792655', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac33b0d-b528-4639-9129-b9a3e5439449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:00 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Volume volume-2f768842-229d-4836-b0db-a11f9d792655 (2f768842-229d-4836-b0db-a11f9d792655): created successfully Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac33b0d-b528-4639-9129-b9a3e5439449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Flow 'volume_create_manager' (93962d87-9dff-4ddd-989b-cbc415d7fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:00 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-95318787-0885-444a-8fda-3cd8beded0b1 req-341366b1-72e4-4989-8ef0-b27e5ab88b81 tempest-VolumesGetTestJSON-1931298233 None] Created volume successfully. Jul 05 19:49:01 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa" returned: 0 in 0.875s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-quobyte-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa" released by "delete_volume" :: held 2.173s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Created reservations ['1748a0c3-05ad-4d83-a849-89ef89516450', 'de72a34a-6e08-45ad-8464-963c1a1477b8', 'fea16a84-ed74-4807-b26b-e15e0b0c9de3', '5cd1ec7f-1655-4264-92eb-44ea0d340f25'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:01 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:01 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Acquiring lock "cinder-2f768842-229d-4836-b0db-a11f9d792655-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Lock "cinder-2f768842-229d-4836-b0db-a11f9d792655-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Acquiring lock "cinder-quobyte-2f768842-229d-4836-b0db-a11f9d792655" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Lock "cinder-quobyte-2f768842-229d-4836-b0db-a11f9d792655" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6fa667-2380-46b8-b502-1cccbc641d40]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:02 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:02 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655 Jul 05 19:49:02 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.937s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Deleted volume successfully. Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5a3c64af-6919-4a14-97c2-c579f0099a52 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-47bdada6-e8e9-4fb9-99da-5c9f0d725ffa-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Flow 'volume_create_manager' (6c21dda9-be55-44d1-b94e-e2ab1a4139dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02b488d-b98f-41fd-b400-e5199a2d0258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02b488d-b98f-41fd-b400-e5199a2d0258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067947213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb92c4a-79a7-4007-bf14-70719db96feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c34e551744a0caab648aa047fdbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:03Z,use_quota=True,user_id='dd94246fa99146b5b18f6ddc2f9dd07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513cf627-6ab9-4b4f-8d4f-b9a668933451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513cf627-6ab9-4b4f-8d4f-b9a668933451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3c47db-3dc9-4e5f-85c8-87243794f156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3c47db-3dc9-4e5f-85c8-87243794f156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb92c4a-79a7-4007-bf14-70719db96feb', 'volume_name': 'volume-cdb92c4a-79a7-4007-bf14-70719db96feb', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57f2840-85c1-423c-b4c9-f2ad04a11b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57f2840-85c1-423c-b4c9-f2ad04a11b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f2820-11e8-431d-82f0-82e1f88c7b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:02 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Volume cdb92c4a-79a7-4007-bf14-70719db96feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb92c4a-79a7-4007-bf14-70719db96feb', 'volume_size': 1} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067947213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb92c4a-79a7-4007-bf14-70719db96feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c34e551744a0caab648aa047fdbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:03Z,use_quota=True,user_id='dd94246fa99146b5b18f6ddc2f9dd07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Creating volume cdb92c4a-79a7-4007-bf14-70719db96feb {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:02 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:02 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb 1073741824 Jul 05 19:49:02 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:03 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655" returned: 0 in 1.160s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:03 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655 Jul 05 19:49:03 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:04 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2f768842-229d-4836-b0db-a11f9d792655" returned: 0 in 0.902s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Lock "cinder-quobyte-2f768842-229d-4836-b0db-a11f9d792655" released by "delete_volume" :: held 2.132s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG cinder.quota [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Created reservations ['20f661fc-66dd-4e8e-9548-049c4287f0e6', 'd1f9ec59-b34e-40bd-b139-8b0118b638a6', '6a09f4fb-4b14-4fa1-a01c-0ac503b1e233', 'f38fa2bc-59b0-4ffe-afd1-348cd44acfc0'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:04 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:04 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:04 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb 1073741824" returned: 0 in 1.396s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:04 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb Jul 05 19:49:04 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:05 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.893s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG cinder.manager [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:05 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Deleted volume successfully. Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [req-af110fc9-cc0b-4642-a233-44eca809f931 req-236907f5-43ca-4f23-aa07-a5a281c1d551 tempest-VolumesGetTestJSON-1931298233 None] Lock "cinder-2f768842-229d-4836-b0db-a11f9d792655-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:05 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb" returned: 0 in 1.096s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] <== create_volume: return (2541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.543s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f2820-11e8-431d-82f0-82e1f88c7b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb92c4a-79a7-4007-bf14-70719db96feb', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1825c9a1-e443-4c1d-ae02-09a3a7699554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:05 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Volume volume-cdb92c4a-79a7-4007-bf14-70719db96feb (cdb92c4a-79a7-4007-bf14-70719db96feb): created successfully Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1825c9a1-e443-4c1d-ae02-09a3a7699554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Flow 'volume_create_manager' (6c21dda9-be55-44d1-b94e-e2ab1a4139dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:05 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-86cf3f12-8323-45db-815a-56cef842ea77 tempest-ProjectReaderTests-1575227742 None] Created volume successfully. Jul 05 19:49:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "cinder-cdb92c4a-79a7-4007-bf14-70719db96feb-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-cdb92c4a-79a7-4007-bf14-70719db96feb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "cinder-quobyte-cdb92c4a-79a7-4007-bf14-70719db96feb" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-quobyte-cdb92c4a-79a7-4007-bf14-70719db96feb" acquired by "delete_volume" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:06 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562ed85-24be-4cb7-aba5-f5dfb29e9381]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:06 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb Jul 05 19:49:06 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:07 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb" returned: 0 in 0.956s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:07 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb Jul 05 19:49:07 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:08 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-cdb92c4a-79a7-4007-bf14-70719db96feb" returned: 0 in 0.839s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-quobyte-cdb92c4a-79a7-4007-bf14-70719db96feb" released by "delete_volume" :: held 1.884s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:08 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Created reservations ['6a79cb65-1f29-48f9-8194-cbd71ec19290', '1173c8dc-4cd2-4915-b79f-9b9005359226', '8b3518dd-7c55-40f3-a3ce-63f29783f4f6', 'ad52db62-d512-477c-aa5c-898da02810cd'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:08 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:08 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Flow 'volume_create_manager' (41f83412-f452-4e44-89ed-f8fe4c65e36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d6fc54-240a-4a9f-9c69-33cf9502a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d6fc54-240a-4a9f-9c69-33cf9502a525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1265176070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781b3791-7ed6-4bc0-9ca6-849c1ef621ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c34e551744a0caab648aa047fdbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:09Z,use_quota=True,user_id='dd94246fa99146b5b18f6ddc2f9dd07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbb9d1d-9369-4c6d-9874-c6b548f01a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbb9d1d-9369-4c6d-9874-c6b548f01a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d524982-4bea-490e-a230-482689437212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d524982-4bea-490e-a230-482689437212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781b3791-7ed6-4bc0-9ca6-849c1ef621ff', 'volume_name': 'volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12493351-1e41-4999-9dc0-62b4bd1a4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12493351-1e41-4999-9dc0-62b4bd1a4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b761ccc0-5867-4966-aebd-1afb0d0d6a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:09 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Volume 781b3791-7ed6-4bc0-9ca6-849c1ef621ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff', 'volume_size': 1} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1265176070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781b3791-7ed6-4bc0-9ca6-849c1ef621ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c34e551744a0caab648aa047fdbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:09Z,use_quota=True,user_id='dd94246fa99146b5b18f6ddc2f9dd07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Creating volume 781b3791-7ed6-4bc0-9ca6-849c1ef621ff {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:09 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:09 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff 1073741824 Jul 05 19:49:09 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:09 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.008s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:09 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Deleted volume successfully. Jul 05 19:49:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ad8c6a16-4cf3-44e6-9df2-424142283e31 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-cdb92c4a-79a7-4007-bf14-70719db96feb-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Flow 'volume_create_manager' (5d1db6fa-617f-4ca1-b6b1-93aee19a3db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e1e8b7-cc5e-4947-9bec-d4500f1798f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e1e8b7-cc5e-4947-9bec-d4500f1798f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-768472701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbc8032-0062-4fab-be93-fc8506f193a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de13205ce16b4147ba34f28f70387395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:10Z,use_quota=True,user_id='a05625ff62734067b665c64d0d2d86bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe4f5a-e7d1-45c0-89ac-f10b7c6e60bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe4f5a-e7d1-45c0-89ac-f10b7c6e60bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6293c87f-4287-47c1-aa51-9a2869004100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6293c87f-4287-47c1-aa51-9a2869004100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bbc8032-0062-4fab-be93-fc8506f193a0', 'volume_name': 'volume-8bbc8032-0062-4fab-be93-fc8506f193a0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539dc502-84de-4d01-a658-4b6ca27edc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539dc502-84de-4d01-a658-4b6ca27edc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b22ed25-d9ef-4218-aa7a-ab2749b121c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Volume 8bbc8032-0062-4fab-be93-fc8506f193a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bbc8032-0062-4fab-be93-fc8506f193a0', 'volume_size': 1} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:10 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff 1073741824" returned: 0 in 1.058s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:10 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff Jul 05 19:49:10 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Flow 'volume_create_manager' (1127195f-dc2d-4d06-b717-e8156a1823ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671038a5-073e-4ecf-9a2a-eb0ab61592e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671038a5-073e-4ecf-9a2a-eb0ab61592e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-744330830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c45fd59-d152-4508-8a79-c7d6d8b2e4d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f052fcbaef8640799f672f0087a60a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:11Z,use_quota=True,user_id='69bb9418c14f4958ae44ef68c840d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2615381-1f35-4458-9c57-0afb7cae2c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2615381-1f35-4458-9c57-0afb7cae2c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117ffa4f-7e6b-48df-a29c-817a6ebb965b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117ffa4f-7e6b-48df-a29c-817a6ebb965b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c45fd59-d152-4508-8a79-c7d6d8b2e4d5', 'volume_name': 'volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e14977-b6c6-4b7b-8d7b-98bac56fa0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e14977-b6c6-4b7b-8d7b-98bac56fa0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194e4844-85b2-47eb-9648-6a04442a141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:10 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Volume 6c45fd59-d152-4508-8a79-c7d6d8b2e4d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5', 'volume_size': 1} Jul 05 19:49:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:11 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff" returned: 0 in 0.713s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.930s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-768472701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbc8032-0062-4fab-be93-fc8506f193a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de13205ce16b4147ba34f28f70387395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:10Z,use_quota=True,user_id='a05625ff62734067b665c64d0d2d86bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Creating volume 8bbc8032-0062-4fab-be93-fc8506f193a0 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:11 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:11 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0 1073741824 Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b761ccc0-5867-4966-aebd-1afb0d0d6a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:11 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a345a9-bc6a-4798-8f49-31bc5347513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:11 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Volume volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff (781b3791-7ed6-4bc0-9ca6-849c1ef621ff): created successfully Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a345a9-bc6a-4798-8f49-31bc5347513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Flow 'volume_create_manager' (41f83412-f452-4e44-89ed-f8fe4c65e36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6e8e8f24-0cbf-4ca0-8d0d-5f8ec56c461b tempest-ProjectReaderTests-1575227742 None] Created volume successfully. Jul 05 19:49:11 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0 1073741824" returned: 0 in 0.889s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:12 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0 Jul 05 19:49:12 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "cinder-781b3791-7ed6-4bc0-9ca6-849c1ef621ff-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-781b3791-7ed6-4bc0-9ca6-849c1ef621ff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "cinder-quobyte-781b3791-7ed6-4bc0-9ca6-849c1ef621ff" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-quobyte-781b3791-7ed6-4bc0-9ca6-849c1ef621ff" acquired by "delete_volume" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee47d89-23e4-4e72-b42f-b8f90e93f63d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:12 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff Jul 05 19:49:12 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:12 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0" returned: 0 in 0.722s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-744330830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c45fd59-d152-4508-8a79-c7d6d8b2e4d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f052fcbaef8640799f672f0087a60a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:11Z,use_quota=True,user_id='69bb9418c14f4958ae44ef68c840d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Creating volume 6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:12 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:12 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 1073741824 Jul 05 19:49:12 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b22ed25-d9ef-4218-aa7a-ab2749b121c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbc8032-0062-4fab-be93-fc8506f193a0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9e46e4-4359-49c6-9bae-f46a3b82ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:12 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Volume volume-8bbc8032-0062-4fab-be93-fc8506f193a0 (8bbc8032-0062-4fab-be93-fc8506f193a0): created successfully Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9e46e4-4359-49c6-9bae-f46a3b82ef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Flow 'volume_create_manager' (5d1db6fa-617f-4ca1-b6b1-93aee19a3db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:12 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2b3942f9-1f60-4f9a-b46a-2b3a2320c337 tempest-VolumesTransfersV357Test-236815657 None] Created volume successfully. Jul 05 19:49:13 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff" returned: 0 in 0.875s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:13 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff Jul 05 19:49:13 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:13 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 1073741824" returned: 0 in 1.014s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:13 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 Jul 05 19:49:13 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:13 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d1507739-465c-4923-a140-1d1866906baa tempest-VolumesTransfersV357Test-544692093 None] Transfer volume completed successfully. Jul 05 19:49:14 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-781b3791-7ed6-4bc0-9ca6-849c1ef621ff" returned: 0 in 0.807s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-quobyte-781b3791-7ed6-4bc0-9ca6-849c1ef621ff" released by "delete_volume" :: held 1.734s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Created reservations ['499d217d-6d06-4642-b1b8-ac0a873d573d', 'a9871fd9-1e98-4ae1-aece-d8528b6687e6', '927e983a-b757-41fb-a017-0cc4d61f9e37', '3f08ea60-de6f-49ed-9912-17bea26f8639'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:14 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:14 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:14 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5" returned: 0 in 0.734s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194e4844-85b2-47eb-9648-6a04442a141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e197eb73-37b4-4bc5-bb6a-114039a5b1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:14 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Volume volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 (6c45fd59-d152-4508-8a79-c7d6d8b2e4d5): created successfully Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e197eb73-37b4-4bc5-bb6a-114039a5b1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Flow 'volume_create_manager' (1127195f-dc2d-4d06-b717-e8156a1823ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:14 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-dfc4ef01-fcea-4834-84b9-f97e0350e554 tempest-VolumesTestJSON-1606988772 None] Created volume successfully. Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Flow 'volume_create_manager' (ca12999d-adc2-4eba-b820-d918d27a7a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d772a12c-2689-4f71-8a2c-07922bfe6a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d772a12c-2689-4f71-8a2c-07922bfe6a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba0ea06-5960-4310-a727-64bdfe10d9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c4e7c86a6f4964b96e44157c1f0bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:15Z,use_quota=True,user_id='beb5f1a552c04c67bbfa5044dddc1496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae46538-d595-4ca2-a059-29bbf7c2bf5f),volume_type_id=6ae46538-d595-4ca2-a059-29bbf7c2bf5f)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac93ef7-36f0-4b58-bf85-4c70eb8095a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac93ef7-36f0-4b58-bf85-4c70eb8095a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdaba613-d7eb-4f7d-af05-cfc807ead828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:14 devstack cinder-volume[86389]: DEBUG cinder.image.glance [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Creating Keystone auth plugin from conf {{(pid=86389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdaba613-d7eb-4f7d-af05-cfc807ead828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ba0ea06-5960-4310-a727-64bdfe10d9fa', 'volume_name': 'volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa', 'volume_size': 1, 'image_id': '92d71c51-55ba-4219-af5f-8a3effe5e484', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92d71c51-55ba-4219-af5f-8a3effe5e484', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6c792a369c60526123c6540b59e3b6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09c4e7c86a6f4964b96e44157c1f0bda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0ea663a43b34d2637dc16ff3774db59e6f3f40fdc6eb9f9f1337ffb44e7af9f6cf200a9e74ea53c0328f82ac9cf2388d033fbe999ae98a356cb424fd3e795ac', 'id': '92d71c51-55ba-4219-af5f-8a3effe5e484', 'created_at': datetime.datetime(2026, 7, 5, 17, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92d71c51-55ba-4219-af5f-8a3effe5e484/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f8549e-af83-4b74-8b97-73bf94c51630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f8549e-af83-4b74-8b97-73bf94c51630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7160162-83c4-4518-903e-84435d4c51e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Volume 2ba0ea06-5960-4310-a727-64bdfe10d9fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa', 'volume_size': 1, 'image_id': '92d71c51-55ba-4219-af5f-8a3effe5e484', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92d71c51-55ba-4219-af5f-8a3effe5e484', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6c792a369c60526123c6540b59e3b6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09c4e7c86a6f4964b96e44157c1f0bda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0ea663a43b34d2637dc16ff3774db59e6f3f40fdc6eb9f9f1337ffb44e7af9f6cf200a9e74ea53c0328f82ac9cf2388d033fbe999ae98a356cb424fd3e795ac', 'id': '92d71c51-55ba-4219-af5f-8a3effe5e484', 'created_at': datetime.datetime(2026, 7, 5, 17, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92d71c51-55ba-4219-af5f-8a3effe5e484/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Trying to clone 2ba0ea06-5960-4310-a727-64bdfe10d9fa from image 92d71c51-55ba-4219-af5f-8a3effe5e484 at location (None, [{'url': 'file:///opt/stack/data/glance/images/92d71c51-55ba-4219-af5f-8a3effe5e484', 'metadata': {}}]). {{(pid=86389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.890s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Deleted volume successfully. Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-57ee94e7-1001-4aca-bdc3-17f167c1d634 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-781b3791-7ed6-4bc0-9ca6-849c1ef621ff-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Acquiring lock "cinder-8bbc8032-0062-4fab-be93-fc8506f193a0-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Lock "cinder-8bbc8032-0062-4fab-be93-fc8506f193a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Flow 'volume_create_manager' (fa332fe5-e867-4162-8f3f-5539044e90c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3351c0d2-3b4d-46bd-8e5e-83c82c830c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 19:49:15 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Image download 0.00 MB at 0.00 MB/s Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3351c0d2-3b4d-46bd-8e5e-83c82c830c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536712374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed3d53b-1b4a-4458-a1a0-64d4a36b7111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c34e551744a0caab648aa047fdbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:15Z,use_quota=True,user_id='dd94246fa99146b5b18f6ddc2f9dd07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98f173a-e9ff-4804-816d-07bcadce8956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98f173a-e9ff-4804-816d-07bcadce8956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7aa981-cbb2-461d-bd29-3cba7f7d3498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7aa981-cbb2-461d-bd29-3cba7f7d3498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed3d53b-1b4a-4458-a1a0-64d4a36b7111', 'volume_name': 'volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d423262-7df2-4dd5-9578-5e8e8d35cfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d423262-7df2-4dd5-9578-5e8e8d35cfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c986d19-40d3-4c04-82e4-0b540568dbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Volume 1ed3d53b-1b4a-4458-a1a0-64d4a36b7111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111', 'volume_size': 1} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536712374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed3d53b-1b4a-4458-a1a0-64d4a36b7111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c34e551744a0caab648aa047fdbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:15Z,use_quota=True,user_id='dd94246fa99146b5b18f6ddc2f9dd07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Creating volume 1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:15 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:15 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 1073741824 Jul 05 19:49:15 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Acquiring lock "cinder-quobyte-8bbc8032-0062-4fab-be93-fc8506f193a0" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Lock "cinder-quobyte-8bbc8032-0062-4fab-be93-fc8506f193a0" acquired by "delete_volume" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6896a3f7-8c61-4980-b691-6be41be3cd5f]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[032d5883-44ad-4019-9b26-2720b8290523]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:15 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0 Jul 05 19:49:15 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:15 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD Jul 05 19:49:15 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Flow 'volume_create_manager' (e19aade6-793d-4409-9f47-a201bafc8abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086a83eb-3746-4e40-a193-3d2ab9281f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086a83eb-3746-4e40-a193-3d2ab9281f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-614084164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d69684-d119-4ac3-8d37-e99ea0728b5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f052fcbaef8640799f672f0087a60a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:16Z,use_quota=True,user_id='69bb9418c14f4958ae44ef68c840d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf03258-a8e4-4ea1-9d37-76616f056df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf03258-a8e4-4ea1-9d37-76616f056df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e01030-2658-451d-96fd-930e09d945fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e01030-2658-451d-96fd-930e09d945fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d69684-d119-4ac3-8d37-e99ea0728b5e', 'volume_name': 'volume-81d69684-d119-4ac3-8d37-e99ea0728b5e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246f3e1b-5324-47e8-bdc8-2dae0e5319d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246f3e1b-5324-47e8-bdc8-2dae0e5319d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5c3374-76b7-4a86-a980-f5a279d33739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:15 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Volume 81d69684-d119-4ac3-8d37-e99ea0728b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d69684-d119-4ac3-8d37-e99ea0728b5e', 'volume_size': 1} Jul 05 19:49:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:16 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:16 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:16 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 1073741824" returned: 0 in 0.999s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:16 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD" returned: 0 in 0.961s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:16 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 Jul 05 19:49:16 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:16 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0" returned: 0 in 1.004s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:16 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0 Jul 05 19:49:16 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:16 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD Jul 05 19:49:16 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:16 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.742s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:49:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:49:17 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111" returned: 0 in 0.710s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.281s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-614084164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d69684-d119-4ac3-8d37-e99ea0728b5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f052fcbaef8640799f672f0087a60a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:16Z,use_quota=True,user_id='69bb9418c14f4958ae44ef68c840d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Creating volume 81d69684-d119-4ac3-8d37-e99ea0728b5e {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:17 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c986d19-40d3-4c04-82e4-0b540568dbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:17 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e 1073741824 Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df41b83f-df68-40d6-989b-af27d74b6867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:17 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:17 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:17 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Volume volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 (1ed3d53b-1b4a-4458-a1a0-64d4a36b7111): created successfully Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df41b83f-df68-40d6-989b-af27d74b6867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:17 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Flow 'volume_create_manager' (fa332fe5-e867-4162-8f3f-5539044e90c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD" returned: 1 in 0.814s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8bbc8032-0062-4fab-be93-fc8506f193a0" returned: 0 in 0.749s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Temporary image 92d71c51-55ba-4219-af5f-8a3effe5e484 is fetched for user beb5f1a552c04c67bbfa5044dddc1496. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 19:49:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-33b36865-8244-4ab5-bbfc-0fac82fd42f3 tempest-ProjectReaderTests-1575227742 None] Created volume successfully. Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Lock "cinder-quobyte-8bbc8032-0062-4fab-be93-fc8506f193a0" released by "delete_volume" :: held 1.824s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f9fd69-7da6-4f80-87b4-fe96d18c823d]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Created reservations ['29950586-742a-4aec-8492-8ec2d574fc12', '23a5df75-dac8-4be5-b3a4-25c58299976b', '951347ba-8641-42ea-9653-f317a0902c25', '42e5507b-120f-4f07-9bcf-4295918da55b'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:17 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:17 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:17 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD Jul 05 19:49:17 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:18 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e 1073741824" returned: 0 in 1.034s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Flow 'volume_create_manager' (d3393538-e1ce-4f69-bb9e-e969eae98ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f03c45-156f-4ccb-b83d-f562684b2ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:18 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f03c45-156f-4ccb-b83d-f562684b2ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1677208791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed59dd4-9dd2-4621-979b-ccb8ca56cfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de13205ce16b4147ba34f28f70387395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:18Z,use_quota=True,user_id='a05625ff62734067b665c64d0d2d86bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a2ddf6-96b1-4e44-82ed-c45ceaeac07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a2ddf6-96b1-4e44-82ed-c45ceaeac07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec15f7e-7f7c-4b0f-b16c-fb9f9a2c784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:18 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec15f7e-7f7c-4b0f-b16c-fb9f9a2c784b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed59dd4-9dd2-4621-979b-ccb8ca56cfb7', 'volume_name': 'volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70a42d8-398f-4f65-9896-3af2b4535384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70a42d8-398f-4f65-9896-3af2b4535384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1a2f03-aa86-4091-b91b-fa085c0e22fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:18 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Volume aed59dd4-9dd2-4621-979b-ccb8ca56cfb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7', 'volume_size': 1} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.893s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD" returned: 0 in 1.008s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:18 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e Jul 05 19:49:18 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:18 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Deleted volume successfully. Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-91b136f3-acc1-416a-a29e-77b0b427d377 tempest-VolumesTransfersV357Test-1497909591 None] Lock "cinder-8bbc8032-0062-4fab-be93-fc8506f193a0-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "cinder-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:18 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD Jul 05 19:49:18 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "cinder-quobyte-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-quobyte-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[52974d75-4f29-46b9-8b78-46b4ed8f25c6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:18 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 Jul 05 19:49:18 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:19 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e" returned: 0 in 0.707s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1677208791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed59dd4-9dd2-4621-979b-ccb8ca56cfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de13205ce16b4147ba34f28f70387395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:18Z,use_quota=True,user_id='a05625ff62734067b665c64d0d2d86bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Creating volume aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:19 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5c3374-76b7-4a86-a980-f5a279d33739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d69684-d119-4ac3-8d37-e99ea0728b5e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:19 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 1073741824 Jul 05 19:49:19 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b265f27-b333-406e-9dcc-baf162d34be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:19 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Volume volume-81d69684-d119-4ac3-8d37-e99ea0728b5e (81d69684-d119-4ac3-8d37-e99ea0728b5e): created successfully Jul 05 19:49:19 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b265f27-b333-406e-9dcc-baf162d34be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Flow 'volume_create_manager' (e19aade6-793d-4409-9f47-a201bafc8abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD" returned: 1 in 0.786s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:19 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-36e24bef-f80a-4e64-9e5b-c4f94e2d10e7 tempest-VolumesTestJSON-1606988772 None] Created volume successfully. Jul 05 19:49:19 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111" returned: 0 in 0.832s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:19 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111 Jul 05 19:49:19 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:19 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 1073741824" returned: 0 in 0.837s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:20 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 Jul 05 19:49:20 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:20 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111" returned: 0 in 0.680s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-quobyte-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111" released by "delete_volume" :: held 1.566s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Created reservations ['3dd6eb7d-d058-4bc7-b299-739dd213cedd', '526c7c98-0333-42ad-8f18-1cf87724905e', 'c4a05951-a7c2-4024-bdbc-ab9fd97a1ace', '215cbcbd-f6d6-4017-9e6d-c2fd4afb8891'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:20 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:20 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:20 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7" returned: 0 in 0.674s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.487s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba0ea06-5960-4310-a727-64bdfe10d9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c4e7c86a6f4964b96e44157c1f0bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:15Z,use_quota=True,user_id='beb5f1a552c04c67bbfa5044dddc1496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae46538-d595-4ca2-a059-29bbf7c2bf5f),volume_type_id=6ae46538-d595-4ca2-a059-29bbf7c2bf5f)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Creating volume 2ba0ea06-5960-4310-a727-64bdfe10d9fa {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:20 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:20 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa 1073741824 Jul 05 19:49:20 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1a2f03-aa86-4091-b91b-fa085c0e22fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96361dcb-9f4f-46a9-9a7c-d79c5cb271bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:20 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Volume volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 (aed59dd4-9dd2-4621-979b-ccb8ca56cfb7): created successfully Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96361dcb-9f4f-46a9-9a7c-d79c5cb271bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Flow 'volume_create_manager' (d3393538-e1ce-4f69-bb9e-e969eae98ff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Flow 'volume_create_manager' (b2297156-5a01-4fdc-bdae-d1529eca719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0458284a-0ecb-41d4-92bc-f55b86318ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-feb6fb4d-98cb-4836-bbf3-975f88b662d1 tempest-VolumesTransfersV357Test-236815657 None] Created volume successfully. Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0458284a-0ecb-41d4-92bc-f55b86318ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1684772784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36f75d3-0675-4b54-bdbd-ac24bda80644,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f052fcbaef8640799f672f0087a60a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:21Z,use_quota=True,user_id='69bb9418c14f4958ae44ef68c840d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26008c7-a549-4e95-90b0-959403fc00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26008c7-a549-4e95-90b0-959403fc00a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b2611d-0d59-409d-9d50-c47e537d1660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b2611d-0d59-409d-9d50-c47e537d1660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36f75d3-0675-4b54-bdbd-ac24bda80644', 'volume_name': 'volume-f36f75d3-0675-4b54-bdbd-ac24bda80644', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf02d0e-58ec-4702-ba73-1f4d74c93a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf02d0e-58ec-4702-ba73-1f4d74c93a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8890f40c-a42c-4906-85d6-9384bd3f5014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:20 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Volume f36f75d3-0675-4b54-bdbd-ac24bda80644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36f75d3-0675-4b54-bdbd-ac24bda80644', 'volume_size': 1} Jul 05 19:49:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:21 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.710s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:21 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Deleted volume successfully. Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-59660c05-1f1b-4918-aa4a-c7a5804a5ae6 tempest-ProjectReaderTests-1575227742 None] Lock "cinder-1ed3d53b-1b4a-4458-a1a0-64d4a36b7111-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:21 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa 1073741824" returned: 0 in 0.959s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:21 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa Jul 05 19:49:21 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Acquiring lock "cinder-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Lock "cinder-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Acquiring lock "cinder-quobyte-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Lock "cinder-quobyte-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[90720de7-d055-4dae-9ee3-51761f4f36d5]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:22 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 Jul 05 19:49:22 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:22 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa" returned: 0 in 0.805s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1684772784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36f75d3-0675-4b54-bdbd-ac24bda80644,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f052fcbaef8640799f672f0087a60a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:21Z,use_quota=True,user_id='69bb9418c14f4958ae44ef68c840d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Creating volume f36f75d3-0675-4b54-bdbd-ac24bda80644 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:22 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:22 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 1073741824 Jul 05 19:49:22 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Attempting download of 92d71c51-55ba-4219-af5f-8a3effe5e484 ((None, [{'url': 'file:///opt/stack/data/glance/images/92d71c51-55ba-4219-af5f-8a3effe5e484', 'metadata': {}}])) to volume 2ba0ea06-5960-4310-a727-64bdfe10d9fa. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ab860b-34a8-4ea8-ae21-c44b647b5821]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92d71c51-55ba-4219-af5f-8a3effe5e484_xy6i8ap2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:22 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92d71c51-55ba-4219-af5f-8a3effe5e484_xy6i8ap2 Jul 05 19:49:22 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:22 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7" returned: 0 in 0.941s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:22 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7 Jul 05 19:49:22 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:23 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92d71c51-55ba-4219-af5f-8a3effe5e484_xy6i8ap2" returned: 0 in 0.878s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92d71c51-55ba-4219-af5f-8a3effe5e484_xy6i8ap2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:23 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 1073741824" returned: 0 in 1.030s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:23 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92d71c51-55ba-4219-af5f-8a3effe5e484_xy6i8ap2 Jul 05 19:49:23 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 Jul 05 19:49:23 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:23 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:23 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7" returned: 0 in 0.769s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Lock "cinder-quobyte-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7" released by "delete_volume" :: held 1.766s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Created reservations ['7bff6269-e4f8-4953-8629-785e02298c79', '489e3e39-2c0b-4b15-89e5-920a4159cf55', '9144589f-5aa5-4920-95b0-b8573052f432', '1f835189-de01-45f9-99ae-5f61bbcc2c69'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:23 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:23 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:24 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92d71c51-55ba-4219-af5f-8a3effe5e484_xy6i8ap2" returned: 1 in 0.956s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92d71c51-55ba-4219-af5f-8a3effe5e484_xy6i8ap2' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[798d1842-2519-4bf3-94ce-2c49f0b07397]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:24 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD Jul 05 19:49:24 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:24 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644" returned: 0 in 1.029s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8890f40c-a42c-4906-85d6-9384bd3f5014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36f75d3-0675-4b54-bdbd-ac24bda80644', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7356361d-d7d2-4bd5-987b-c9b25f11b670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:24 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Volume volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 (f36f75d3-0675-4b54-bdbd-ac24bda80644): created successfully Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7356361d-d7d2-4bd5-987b-c9b25f11b670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Flow 'volume_create_manager' (b2297156-5a01-4fdc-bdae-d1529eca719d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.912s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:24 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Deleted volume successfully. Jul 05 19:49:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d881448d-5cd2-4656-ae55-f5066d765d65 tempest-VolumesTestJSON-1606988772 None] Created volume successfully. Jul 05 19:49:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-dd1eb69d-c7bc-43d5-b0a3-aab24a565924 tempest-VolumesTransfersV357Test-1497909591 None] Lock "cinder-aed59dd4-9dd2-4621-979b-ccb8ca56cfb7-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:25 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD" returned: 0 in 1.151s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:25 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD Jul 05 19:49:25 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "cinder-f36f75d3-0675-4b54-bdbd-ac24bda80644-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-f36f75d3-0675-4b54-bdbd-ac24bda80644-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "cinder-quobyte-f36f75d3-0675-4b54-bdbd-ac24bda80644" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-quobyte-f36f75d3-0675-4b54-bdbd-ac24bda80644" acquired by "delete_volume" :: waited 0.039s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e9d443-6127-4a44-a928-be752d92eab5]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:26 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD" returned: 1 in 1.058s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] 92d71c51-55ba-4219-af5f-8a3effe5e484 was raw, converting to raw {{(pid=86389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 19:49:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:26 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa Jul 05 19:49:26 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:26 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 Jul 05 19:49:26 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:27 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa" returned: 0 in 0.957s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:27 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92d71c51-55ba-4219-af5f-8a3effe5e484_4k2gtk_8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:49:27 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 19:49:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:27 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa 1G Jul 05 19:49:27 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:27 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644" returned: 0 in 1.137s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:27 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644 Jul 05 19:49:27 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:28 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa 1G" returned: 0 in 1.058s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:28 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f36f75d3-0675-4b54-bdbd-ac24bda80644" returned: 0 in 0.944s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b85a97f-2f83-42f6-a517-174f6ba23d00]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-quobyte-f36f75d3-0675-4b54-bdbd-ac24bda80644" released by "delete_volume" :: held 2.169s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Created reservations ['b9c49718-27f1-4755-bfd5-f60d9ffb4b19', 'dea018be-c4ea-49ca-9333-9c90461dcc53', '82dbdd70-fd17-48a0-9bfa-8ec15962aded', '6a63ddef-e1fe-4204-98eb-c372fec544a2'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:28 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa Jul 05 19:49:28 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:29 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:29 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:29 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa" returned: 0 in 0.903s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:29 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.850s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:29 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Deleted volume successfully. Jul 05 19:49:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7bbce839-f0d0-4af9-ba02-3c9d5bbb8047 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-f36f75d3-0675-4b54-bdbd-ac24bda80644-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:29 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa Jul 05 19:49:29 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "cinder-81d69684-d119-4ac3-8d37-e99ea0728b5e-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-81d69684-d119-4ac3-8d37-e99ea0728b5e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "cinder-quobyte-81d69684-d119-4ac3-8d37-e99ea0728b5e" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-quobyte-81d69684-d119-4ac3-8d37-e99ea0728b5e" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeba83ae-83ef-48d4-a0a8-32f7b7ac1009]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:30 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e Jul 05 19:49:30 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:30 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa" returned: 1 in 1.084s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Downloaded image 92d71c51-55ba-4219-af5f-8a3effe5e484 ((None, [{'url': 'file:///opt/stack/data/glance/images/92d71c51-55ba-4219-af5f-8a3effe5e484', 'metadata': {}}])) to volume 2ba0ea06-5960-4310-a727-64bdfe10d9fa successfully. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Temporary image 92d71c51-55ba-4219-af5f-8a3effe5e484 for user beb5f1a552c04c67bbfa5044dddc1496 is deleted. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Marking volume 2ba0ea06-5960-4310-a727-64bdfe10d9fa as bootable. {{(pid=86389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Copying metadata from image 92d71c51-55ba-4219-af5f-8a3effe5e484 to 2ba0ea06-5960-4310-a727-64bdfe10d9fa. {{(pid=86389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Creating volume glance metadata for volume 2ba0ea06-5960-4310-a727-64bdfe10d9fa backed by image 92d71c51-55ba-4219-af5f-8a3effe5e484 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '92d71c51-55ba-4219-af5f-8a3effe5e484', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e6c792a369c60526123c6540b59e3b6b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7160162-83c4-4518-903e-84435d4c51e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa', 'volume_size': 1, 'image_id': '92d71c51-55ba-4219-af5f-8a3effe5e484', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92d71c51-55ba-4219-af5f-8a3effe5e484', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6c792a369c60526123c6540b59e3b6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09c4e7c86a6f4964b96e44157c1f0bda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0ea663a43b34d2637dc16ff3774db59e6f3f40fdc6eb9f9f1337ffb44e7af9f6cf200a9e74ea53c0328f82ac9cf2388d033fbe999ae98a356cb424fd3e795ac', 'id': '92d71c51-55ba-4219-af5f-8a3effe5e484', 'created_at': datetime.datetime(2026, 7, 5, 17, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92d71c51-55ba-4219-af5f-8a3effe5e484/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985805c4-a4e4-4a80-a40e-1f6af832617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:30 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Volume volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa (2ba0ea06-5960-4310-a727-64bdfe10d9fa): created successfully Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985805c4-a4e4-4a80-a40e-1f6af832617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Flow 'volume_create_manager' (ca12999d-adc2-4eba-b820-d918d27a7a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:30 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7d59da71-e348-42c9-972a-3447cc323752 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Created volume successfully. Jul 05 19:49:31 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e" returned: 0 in 1.099s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:31 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e Jul 05 19:49:31 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:32 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Acquiring lock "cinder-2ba0ea06-5960-4310-a727-64bdfe10d9fa-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81d69684-d119-4ac3-8d37-e99ea0728b5e" returned: 0 in 0.776s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-quobyte-81d69684-d119-4ac3-8d37-e99ea0728b5e" released by "delete_volume" :: held 1.943s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "cinder-2ba0ea06-5960-4310-a727-64bdfe10d9fa-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Acquiring lock "cinder-quobyte-2ba0ea06-5960-4310-a727-64bdfe10d9fa" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "cinder-quobyte-2ba0ea06-5960-4310-a727-64bdfe10d9fa" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Created reservations ['46b12fcd-222b-47e5-a2b1-ffb5a5701dba', '3d005b7b-e2e1-4e93-aa70-c151333a3dcc', '865d451f-75d2-46d1-a27d-cefb9474cf5d', '2958ef94-bba4-4601-a694-3260b98c283a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[742c086c-9bc5-485a-b35d-20b90a67207a]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:32 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa Jul 05 19:49:32 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:32 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:32 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "cinder-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "cinder-quobyte-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-quobyte-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5" acquired by "delete_volume" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8460f80e-48f2-4a40-bdee-f0cc07e781b2]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:32 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 Jul 05 19:49:32 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:33 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.041s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:33 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Deleted volume successfully. Jul 05 19:49:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1d06f85c-c110-4a9f-9ec3-bde0b7df6b05 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-81d69684-d119-4ac3-8d37-e99ea0728b5e-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:33 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa" returned: 0 in 1.364s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:33 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa Jul 05 19:49:33 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:34 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5" returned: 0 in 1.299s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:34 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5 Jul 05 19:49:34 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:34 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa" returned: 1 in 1.024s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:49:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:34 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa Jul 05 19:49:34 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:35 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5" returned: 0 in 0.981s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-quobyte-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5" released by "delete_volume" :: held 2.367s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Created reservations ['5747b026-34e7-494f-951b-2639491cd984', '3e2bfddf-b4cf-4749-afc3-82a6d223c4c4', '39d9eb9c-3384-44eb-9d36-f9a697b6c7de', '04b7f187-9692-4921-8f6e-df3e2a9259a4'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:35 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:35 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:35 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2ba0ea06-5960-4310-a727-64bdfe10d9fa" returned: 0 in 1.056s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "cinder-quobyte-2ba0ea06-5960-4310-a727-64bdfe10d9fa" released by "delete_volume" :: held 3.539s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:35 devstack cinder-volume[86389]: WARNING cinder.quota [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:49:35 devstack cinder-volume[86389]: WARNING cinder.quota [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Created reservations ['f2f8690b-03a0-4742-94d8-f6745f84c2b9', '38c9138b-2bb8-4d67-a7a0-9ce222aa6a62', 'a2efae01-2655-49b0-b98a-8f76c0068958', 'b59a72a9-66ca-404e-a4f0-609dd7f42945'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=127,cinder:UPDATE=201,cinder:INSERT=50,cinder:DELETE=20 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:35 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:49:35 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:36 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.014s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:36 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:36 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Deleted volume successfully. Jul 05 19:49:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b4153cf3-9eb5-4471-9a45-a16fbce36c98 tempest-VolumesTestJSON-1606988772 None] Lock "cinder-6c45fd59-d152-4508-8a79-c7d6d8b2e4d5-delete_volume" released by "delete_volume" :: held 3.827s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:37 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.106s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:37 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:49:37 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Deleted volume successfully. Jul 05 19:49:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-480493fb-c7ef-498d-9700-a98320dcaa97 tempest-VolumeAndVolumeTypeFromImageTest-306096920 None] Lock "cinder-2ba0ea06-5960-4310-a727-64bdfe10d9fa-delete_volume" released by "delete_volume" :: held 5.029s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:DELETE=14,cinder:SELECT=150,cinder:UPDATE=193,cinder:INSERT=52 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Flow 'volume_create_manager' (19d536ef-4885-4d45-bb83-078b22f5b7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7670e0-1f17-4074-96af-c9786b5d7738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7670e0-1f17-4074-96af-c9786b5d7738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1339071168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61505e4d-695b-4e7a-8ba0-6b093a46c101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7b6d11e8b8468884b5721d9ec1f003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:42Z,use_quota=True,user_id='1263e17111c340c592455518f21a385b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09be66ec-0598-4055-982a-d5350f39213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09be66ec-0598-4055-982a-d5350f39213c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04343827-8369-466d-9f4c-01673a4ac950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04343827-8369-466d-9f4c-01673a4ac950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61505e4d-695b-4e7a-8ba0-6b093a46c101', 'volume_name': 'volume-61505e4d-695b-4e7a-8ba0-6b093a46c101', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ef9276-cae7-480f-b3ee-f0ff7716257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ef9276-cae7-480f-b3ee-f0ff7716257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204ca526-b52d-4a5d-99bd-a837d6fc03d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:42 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Volume 61505e4d-695b-4e7a-8ba0-6b093a46c101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61505e4d-695b-4e7a-8ba0-6b093a46c101', 'volume_size': 1} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1339071168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61505e4d-695b-4e7a-8ba0-6b093a46c101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7b6d11e8b8468884b5721d9ec1f003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:42Z,use_quota=True,user_id='1263e17111c340c592455518f21a385b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Creating volume 61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:42 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:42 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 1073741824 Jul 05 19:49:42 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:43 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 1073741824" returned: 0 in 1.222s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:43 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 Jul 05 19:49:43 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:43 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-bed85e18-3ebf-4341-b8e1-d87ea04df63f tempest-GroupsV314Test-780125792 None] Group tempest-GroupsV314Test-Group-2087275265: creating Jul 05 19:49:43 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-bed85e18-3ebf-4341-b8e1-d87ea04df63f tempest-GroupsV314Test-780125792 None] Group tempest-GroupsV314Test-Group-2087275265: created successfully Jul 05 19:49:43 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-bed85e18-3ebf-4341-b8e1-d87ea04df63f tempest-GroupsV314Test-780125792 None] Create group completed successfully. Jul 05 19:49:44 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101" returned: 0 in 0.884s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204ca526-b52d-4a5d-99bd-a837d6fc03d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61505e4d-695b-4e7a-8ba0-6b093a46c101', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc8b5d7-b4e7-49c6-8f59-60973c0d7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:44 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Volume volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 (61505e4d-695b-4e7a-8ba0-6b093a46c101): created successfully Jul 05 19:49:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc8b5d7-b4e7-49c6-8f59-60973c0d7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Flow 'volume_create_manager' (19d536ef-4885-4d45-bb83-078b22f5b7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d0b88538-595b-4983-8c9e-05d062f3f935 tempest-VolumesActionsTest-1865219570 None] Created volume successfully. Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Flow 'volume_create_manager' (bb1164e0-189c-4d53-858a-29cdfc9c2e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6300fd90-5b74-4fc1-bf60-36759b8e90e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6300fd90-5b74-4fc1-bf60-36759b8e90e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1238570265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca015a6b-be1b-4399-9969-715875c16bb5,host='devstack@QuobyteHD#QuobyteHD',id=848340b0-ea84-49b8-89b7-b03e71320322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712a16976eaf4b8c9789c8682a51362d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:46Z,use_quota=True,user_id='80db63032f8743d7a5af923cd668e878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b8a0add-9493-46de-aa65-ed571aee0f65),volume_type_id=5b8a0add-9493-46de-aa65-ed571aee0f65)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4956d0bf-2ada-4eca-8032-0aa0075d94fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4956d0bf-2ada-4eca-8032-0aa0075d94fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5f30d5-daa6-4175-8dc5-297e284e6de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5f30d5-daa6-4175-8dc5-297e284e6de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848340b0-ea84-49b8-89b7-b03e71320322', 'volume_name': 'volume-848340b0-ea84-49b8-89b7-b03e71320322', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abcd437-c7ab-4887-b6a5-37db7a70d52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abcd437-c7ab-4887-b6a5-37db7a70d52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b289f0-150d-4260-9606-af72c087333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:45 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Volume 848340b0-ea84-49b8-89b7-b03e71320322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848340b0-ea84-49b8-89b7-b03e71320322', 'volume_size': 1} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca015a6b-be1b-4399-9969-715875c16bb5,created_at=2026-07-05T17:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1238570265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca015a6b-be1b-4399-9969-715875c16bb5,host='devstack@QuobyteHD#QuobyteHD',id=848340b0-ea84-49b8-89b7-b03e71320322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712a16976eaf4b8c9789c8682a51362d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:46Z,use_quota=True,user_id='80db63032f8743d7a5af923cd668e878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b8a0add-9493-46de-aa65-ed571aee0f65),volume_type_id=5b8a0add-9493-46de-aa65-ed571aee0f65)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Creating volume 848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:49:45 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:49:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:45 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 1073741824 Jul 05 19:49:45 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:46 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 1073741824" returned: 0 in 1.121s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:47 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 Jul 05 19:49:47 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:47 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322" returned: 0 in 0.905s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:49:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b289f0-150d-4260-9606-af72c087333c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848340b0-ea84-49b8-89b7-b03e71320322', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda14a7b-ceaa-4c4a-86b8-73e27a74181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:48 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Volume volume-848340b0-ea84-49b8-89b7-b03e71320322 (848340b0-ea84-49b8-89b7-b03e71320322): created successfully Jul 05 19:49:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda14a7b-ceaa-4c4a-86b8-73e27a74181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Flow 'volume_create_manager' (bb1164e0-189c-4d53-858a-29cdfc9c2e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-bc5f63c7-18b9-43d9-b7ef-e81e19681b7a tempest-GroupsV314Test-780125792 None] Created volume successfully. Jul 05 19:49:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:49 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Cloning volume 848340b0-ea84-49b8-89b7-b03e71320322 to volume 44b20f30-8cd1-457c-adee-2038434b179c Jul 05 19:49:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Creating offline snapshot fcb4d785-42be-4f7a-827e-ddd4d25d26d2 of volume 848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:49:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daa4280-ba6e-4ecd-9b32-0f4983f836f6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:50 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 Jul 05 19:49:50 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:50 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322" returned: 0 in 1.064s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:51 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 1G Jul 05 19:49:51 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:52 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 1G" returned: 0 in 1.059s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-848340b0-ea84-49b8-89b7-b03e71320322 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:52 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-848340b0-ea84-49b8-89b7-b03e71320322 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 Jul 05 19:49:52 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:52 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-848340b0-ea84-49b8-89b7-b03e71320322 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2" returned: 0 in 0.866s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:52 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:49:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:52 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 Jul 05 19:49:52 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:53 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2" returned: 0 in 0.848s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:53 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.info Jul 05 19:49:53 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:54 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.info" returned: 0 in 0.787s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:54 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:54 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.info Jul 05 19:49:54 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Flow 'volume_create_manager' (121e70ff-c158-4130-8c21-63a4a951ed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33476adf-1b19-46df-8abb-ba71bbe59691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33476adf-1b19-46df-8abb-ba71bbe59691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1143461135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d23dc6-2410-4092-a0f6-bdd1ffba036c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5792aa5398774085a9b7cce317391896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:55Z,use_quota=True,user_id='62d615243a29428e9e988b0714931372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f3b08b-9f46-40e0-a40a-db235b8dc17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f3b08b-9f46-40e0-a40a-db235b8dc17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cac477-22f0-43d0-89a6-07eabd95910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cac477-22f0-43d0-89a6-07eabd95910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d23dc6-2410-4092-a0f6-bdd1ffba036c', 'volume_name': 'volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1e7eb1-db16-4b82-825f-13472b764aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1e7eb1-db16-4b82-825f-13472b764aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2398d6-f6ad-4242-a592-3713b3e2c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:49:54 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Volume 70d23dc6-2410-4092-a0f6-bdd1ffba036c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c', 'volume_size': 1} Jul 05 19:49:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:55 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.info" returned: 0 in 0.663s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Acquiring lock "cinder-quobyte-44b20f30-8cd1-457c-adee-2038434b179c" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Lock "cinder-quobyte-44b20f30-8cd1-457c-adee-2038434b179c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] snapshot: fcb4d785-42be-4f7a-827e-ddd4d25d26d2, volume: 44b20f30-8cd1-457c-adee-2038434b179c, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ae1f8a-d4e4-447a-b893-37fdfd0636f8]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:55 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 Jul 05 19:49:55 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:56 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2" returned: 0 in 0.783s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-848340b0-ea84-49b8-89b7-b03e71320322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:49:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:49:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:49:56 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1811c5a9-9a2c-41b9-a264-dd8adff8831d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:49:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:56 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 Jul 05 19:49:56 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:49:56 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 05 19:49:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322" returned: 0 in 0.806s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:49:56 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:49:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:49:56 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c Jul 05 19:49:56 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:03 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c" returned: 0 in 6.316s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:03 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b0c1e-2d28-4f9c-94cd-cbefee8760c3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:03 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 Jul 05 19:50:03 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:04 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322" returned: 0 in 0.928s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:50:04 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Converted 1024.00 MB image at 162.10 MB/s Jul 05 19:50:04 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c is being set with open permissions: ugo+rw: NotImplementedError Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:04 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c Jul 05 19:50:04 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=14,cinder:DELETE=2,cinder:SELECT=13,cinder:INSERT=4 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=6,cinder:SELECT=11,cinder:DELETE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:50:04 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c" returned: 0 in 0.615s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Lock "cinder-quobyte-44b20f30-8cd1-457c-adee-2038434b179c" released by "_copy_volume_from_snapshot" :: held 9.528s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Acquiring lock "cinder-quobyte-fcb4d785-42be-4f7a-827e-ddd4d25d26d2" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Lock "cinder-quobyte-fcb4d785-42be-4f7a-827e-ddd4d25d26d2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Deleting offline snapshot fcb4d785-42be-4f7a-827e-ddd4d25d26d2 of volume 848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] snapshot_file for this snap is: volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c563f3-39a8-4bf7-8e0c-72cf8b377113]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:04 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 Jul 05 19:50:04 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:05 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2" returned: 0 in 0.753s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-848340b0-ea84-49b8-89b7-b03e71320322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:50:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df81eaa-0945-47d3-92a7-712ee07d4c6c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:05 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 Jul 05 19:50:05 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:06 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322" returned: 0 in 0.747s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:06 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 Jul 05 19:50:06 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:07 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2" returned: 0 in 0.727s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:07 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2 Jul 05 19:50:07 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:07 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322.fcb4d785-42be-4f7a-827e-ddd4d25d26d2" returned: 0 in 0.672s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Lock "cinder-quobyte-fcb4d785-42be-4f7a-827e-ddd4d25d26d2" released by "_delete_snapshot" :: held 3.001s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.049s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1143461135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d23dc6-2410-4092-a0f6-bdd1ffba036c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5792aa5398774085a9b7cce317391896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:49:55Z,use_quota=True,user_id='62d615243a29428e9e988b0714931372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Creating volume 70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:50:07 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:50:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:07 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c 1073741824 Jul 05 19:50:07 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:07 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f6f8e39d-a74a-4a32-aa4b-284329214b9c tempest-GroupsV314Test-780125792 None] Create group from source-group-ca015a6b-be1b-4399-9969-715875c16bb5 completed successfully. Jul 05 19:50:08 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c 1073741824" returned: 0 in 0.831s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:08 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c Jul 05 19:50:08 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Acquiring lock "cinder-quobyte-44b20f30-8cd1-457c-adee-2038434b179c" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Lock "cinder-quobyte-44b20f30-8cd1-457c-adee-2038434b179c" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5dcbfe-54a7-4de6-93f8-adb46c636d01]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:09 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c" returned: 0 in 0.851s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2398d6-f6ad-4242-a592-3713b3e2c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b19112b-92c4-4789-a3d1-131d78babe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:09 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Volume volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c (70d23dc6-2410-4092-a0f6-bdd1ffba036c): created successfully Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b19112b-92c4-4789-a3d1-131d78babe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Flow 'volume_create_manager' (121e70ff-c158-4130-8c21-63a4a951ed5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:50:09 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d148cf42-325c-417b-8c05-a2747d76a763 tempest-SnapshotDependencyTests-1871410352 None] Created volume successfully. Jul 05 19:50:09 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c Jul 05 19:50:09 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Creating offline snapshot 14c17617-7a0a-4334-90e7-2cbae657cf73 of volume 70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:50:10 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4541fdf-120d-4457-a967-72a3c8f473a5]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:10 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c" returned: 0 in 0.844s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:10 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c Jul 05 19:50:10 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:10 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c Jul 05 19:50:10 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:11 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-44b20f30-8cd1-457c-adee-2038434b179c" returned: 0 in 0.727s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:11 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Lock "cinder-quobyte-44b20f30-8cd1-457c-adee-2038434b179c" released by "delete_volume" :: held 1.623s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c" returned: 0 in 0.845s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:11 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 1G Jul 05 19:50:11 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Created reservations ['23eba1d9-d557-47e7-8179-2e7e9d9da164'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:50:11 devstack cinder-volume[86389]: WARNING cinder.quota [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1588673190 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1588673190, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:50:11 devstack cinder-volume[86389]: WARNING cinder.quota [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1588673190 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1588673190, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Created reservations ['980004ad-ea6c-4e60-9412-0baf98ddf860', 'a76b25ee-da36-448b-a527-c617c0d2f08b', 'ad055974-19cf-4eec-a0ac-7e402f239c05', '1c138b9d-b5ba-4f0b-8952-7efa394a791e'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:11 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:50:11 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:12 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 1G" returned: 0 in 1.046s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:12 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.843s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:12 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 Jul 05 19:50:12 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:50:12 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-64434d81-70d7-49cf-9c3c-03c5de1df8e8 tempest-GroupsV314Test-780125792 None] Delete group completed successfully. Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Acquiring lock "cinder-quobyte-848340b0-ea84-49b8-89b7-b03e71320322" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Lock "cinder-quobyte-848340b0-ea84-49b8-89b7-b03e71320322" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccaf2f0-b172-442d-9282-8a2d68794328]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:12 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 Jul 05 19:50:12 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ce25f4ae-83b0-4f72-b738-d23a67b716e6 tempest-VolumesActionsTest-1865219570 None] Acquiring lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101" by "attach_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ce25f4ae-83b0-4f72-b738-d23a67b716e6 tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101" acquired by "attach_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:12 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ce25f4ae-83b0-4f72-b738-d23a67b716e6 tempest-VolumesActionsTest-1865219570 None] Attaching volume 61505e4d-695b-4e7a-8ba0-6b093a46c101 to instance b9af5ecc-18ae-44ee-bade-597a056fd9d3 at mountpoint /dev/vdb on host None. Jul 05 19:50:12 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ce25f4ae-83b0-4f72-b738-d23a67b716e6 tempest-VolumesActionsTest-1865219570 None] Attach volume completed successfully. Jul 05 19:50:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ce25f4ae-83b0-4f72-b738-d23a67b716e6 tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101" released by "attach_volume" :: held 0.140s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:13 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73" returned: 0 in 0.966s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:13 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 is being set with open permissions: ugo+rw Jul 05 19:50:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:13 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 Jul 05 19:50:13 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:13 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322" returned: 0 in 0.923s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:13 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322 Jul 05 19:50:13 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5e3a52d0-3e2f-4d64-953d-ed8bdbb8a8d6 tempest-VolumesActionsTest-1865219570 None] Acquiring lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101-detach_volume" by "detach_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5e3a52d0-3e2f-4d64-953d-ed8bdbb8a8d6 tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:13 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5e3a52d0-3e2f-4d64-953d-ed8bdbb8a8d6 tempest-VolumesActionsTest-1865219570 None] Detaching volume 61505e4d-695b-4e7a-8ba0-6b093a46c101 from instance b9af5ecc-18ae-44ee-bade-597a056fd9d3. Jul 05 19:50:13 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5e3a52d0-3e2f-4d64-953d-ed8bdbb8a8d6 tempest-VolumesActionsTest-1865219570 None] Detach volume completed successfully. Jul 05 19:50:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5e3a52d0-3e2f-4d64-953d-ed8bdbb8a8d6 tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:13 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73" returned: 0 in 0.766s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:14 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.info Jul 05 19:50:14 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:14 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-848340b0-ea84-49b8-89b7-b03e71320322" returned: 0 in 0.767s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Lock "cinder-quobyte-848340b0-ea84-49b8-89b7-b03e71320322" released by "delete_volume" :: held 1.791s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Created reservations ['b63b84c9-ac0d-4290-a38a-13469c47b591'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Created reservations ['7fd4f45e-7e18-4cad-8a5c-e95d745ad417', 'e67d6518-99db-4a87-b50f-8076530868a1', '0e814183-dd48-422a-bb58-4fc0a6d12963', 'c64b0c82-9748-4733-b3d8-82efac25e1cd'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:14 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:50:14 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:14 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.info" returned: 0 in 0.763s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:14 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.info is being set with open permissions: ugo+rw Jul 05 19:50:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:14 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.info Jul 05 19:50:14 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:15 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.730s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:15 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:50:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0744b10f-54fd-457f-8a6b-332b92b3c671 tempest-GroupsV314Test-780125792 None] Delete group completed successfully. Jul 05 19:50:15 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.info" returned: 0 in 0.755s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.257s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9b6c1092-5120-4bf3-aee2-21bbf096e7fe tempest-SnapshotDependencyTests-1871410352 None] Create snapshot completed successfully Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:16 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:50:16 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:16 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.688s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:50:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Flow 'volume_create_manager' (8a95ebe4-a7e6-4207-a1a1-2ff7bea63fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445cdf9d-de7e-43d7-88f6-7127d5da904f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445cdf9d-de7e-43d7-88f6-7127d5da904f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beca3790-ee99-4c4f-ba16-eaaa4b22be4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5792aa5398774085a9b7cce317391896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=14c17617-7a0a-4334-90e7-2cbae657cf73,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:50:17Z,use_quota=True,user_id='62d615243a29428e9e988b0714931372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fb8d0b-433b-481d-9216-521e8d14e03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fb8d0b-433b-481d-9216-521e8d14e03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54faa9a6-cfe0-44f9-9201-28891cbe852f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54faa9a6-cfe0-44f9-9201-28891cbe852f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'beca3790-ee99-4c4f-ba16-eaaa4b22be4d', 'volume_name': 'volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d', 'volume_size': 1, 'snapshot_id': '14c17617-7a0a-4334-90e7-2cbae657cf73'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a6ecda-4dea-464d-91c4-612c49c85e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a6ecda-4dea-464d-91c4-612c49c85e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121f1ccc-b312-4ad9-bc08-f3d23067d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:17 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Volume beca3790-ee99-4c4f-ba16-eaaa4b22be4d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d', 'volume_size': 1, 'snapshot_id': '14c17617-7a0a-4334-90e7-2cbae657cf73'} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "cinder-quobyte-14c17617-7a0a-4334-90e7-2cbae657cf73-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" by "_create_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-14c17617-7a0a-4334-90e7-2cbae657cf73-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Creating volume beca3790-ee99-4c4f-ba16-eaaa4b22be4d from snapshot 14c17617-7a0a-4334-90e7-2cbae657cf73 {{(pid=86389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "cinder-quobyte-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] snapshot: 14c17617-7a0a-4334-90e7-2cbae657cf73, volume: beca3790-ee99-4c4f-ba16-eaaa4b22be4d, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b82a59c-b1ce-4d0a-b17a-74fa5eb9f0af]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:17 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 Jul 05 19:50:17 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:18 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73" returned: 0 in 0.895s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:50:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:50:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:50:18 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4e40e5-cffe-4d12-bd48-69dfc3f91291]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:18 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c Jul 05 19:50:18 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:19 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c" returned: 0 in 0.787s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:19 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:50:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:19 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d Jul 05 19:50:19 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:24 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" returned: 0 in 5.601s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:25 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59a63dd-c7f3-4177-9c41-c5c54fce2ad4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:25 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c Jul 05 19:50:25 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:25 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c" returned: 0 in 0.968s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:25 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:50:25 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Converted 1024.00 MB image at 182.79 MB/s Jul 05 19:50:25 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d is being set with open permissions: ugo+rw Jul 05 19:50:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:25 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d Jul 05 19:50:25 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:26 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" returned: 0 in 0.717s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" released by "_copy_volume_from_snapshot" :: held 9.073s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-14c17617-7a0a-4334-90e7-2cbae657cf73-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" released by "_create_volume_from_snapshot" :: held 9.127s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.153s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121f1ccc-b312-4ad9-bc08-f3d23067d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d', 'volume_size': 1, 'snapshot_id': '14c17617-7a0a-4334-90e7-2cbae657cf73'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8b0e52-dc07-4328-b50c-d18cd8df1867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:26 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Volume volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d (beca3790-ee99-4c4f-ba16-eaaa4b22be4d): created successfully Jul 05 19:50:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8b0e52-dc07-4328-b50c-d18cd8df1867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Flow 'volume_create_manager' (8a95ebe4-a7e6-4207-a1a1-2ff7bea63fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:50:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f8918e5c-d14f-4893-85ac-8af62ce8c224 tempest-SnapshotDependencyTests-1871410352 None] Created volume successfully. Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "cinder-14c17617-7a0a-4334-90e7-2cbae657cf73-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-14c17617-7a0a-4334-90e7-2cbae657cf73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "cinder-quobyte-70d23dc6-2410-4092-a0f6-bdd1ffba036c" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-70d23dc6-2410-4092-a0f6-bdd1ffba036c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "cinder-quobyte-14c17617-7a0a-4334-90e7-2cbae657cf73" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-14c17617-7a0a-4334-90e7-2cbae657cf73" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Deleting offline snapshot 14c17617-7a0a-4334-90e7-2cbae657cf73 of volume 70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] snapshot_file for this snap is: volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7b4c3b-1e91-4fda-81c1-73140a4a0fef]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:27 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 Jul 05 19:50:27 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:28 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73" returned: 0 in 0.798s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:50:28 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[522a1172-c9a7-4c48-8f48-ddea0df3246d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:28 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c Jul 05 19:50:28 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:29 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c" returned: 0 in 0.831s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:29 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 Jul 05 19:50:29 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:30 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73" returned: 0 in 0.832s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:30 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73 Jul 05 19:50:30 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:30 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c.14c17617-7a0a-4334-90e7-2cbae657cf73" returned: 0 in 0.772s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:30 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-14c17617-7a0a-4334-90e7-2cbae657cf73" released by "_delete_snapshot" :: held 3.372s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:30 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-70d23dc6-2410-4092-a0f6-bdd1ffba036c" released by "delete_snapshot" :: held 3.401s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:30 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Created reservations ['455913e1-d555-475c-86e6-433582e2dbc0', 'b5c4aa6c-aa09-4c9d-a061-225be7a4e257', 'd8546d03-54e7-43d1-9cba-75ff606416c7', '76a6a405-ae2c-491f-a0ad-2089fdf70b3d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:50:31 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Delete snapshot completed successfully. Jul 05 19:50:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13b567e-fe01-4b94-9cc2-d68afdae1f84 tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-14c17617-7a0a-4334-90e7-2cbae657cf73-delete_snapshot" released by "delete_snapshot" :: held 3.626s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "cinder-70d23dc6-2410-4092-a0f6-bdd1ffba036c-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-70d23dc6-2410-4092-a0f6-bdd1ffba036c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "cinder-quobyte-70d23dc6-2410-4092-a0f6-bdd1ffba036c" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-70d23dc6-2410-4092-a0f6-bdd1ffba036c" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:31 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf319f4-a5d9-438e-993f-44e26cb1bfdd]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:32 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c Jul 05 19:50:32 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:32 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c" returned: 0 in 0.834s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:32 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c Jul 05 19:50:32 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:33 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-70d23dc6-2410-4092-a0f6-bdd1ffba036c" returned: 0 in 0.676s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-70d23dc6-2410-4092-a0f6-bdd1ffba036c" released by "delete_volume" :: held 1.576s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:33 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Created reservations ['c8ca6952-bfe2-4f4c-a2ce-4fcdabee1184', 'a615e10e-e11c-40e3-9f5a-1453029c2041', '1e2fa84b-56c9-4a55-aade-3f1b2197363a', 'a1a6733e-51b9-428c-8cd6-021f09e83781'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:50:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:33 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:50:33 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "cinder-beca3790-ee99-4c4f-ba16-eaaa4b22be4d-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-beca3790-ee99-4c4f-ba16-eaaa4b22be4d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "cinder-quobyte-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:34 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c3216c-e4fc-4400-a597-b453863abc2c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:34 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.789s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:34 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:50:34 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Deleted volume successfully. Jul 05 19:50:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6e41f7dc-45df-4894-9591-86677fabe11d tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-70d23dc6-2410-4092-a0f6-bdd1ffba036c-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:34 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d Jul 05 19:50:34 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:35 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" returned: 0 in 0.841s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:35 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d Jul 05 19:50:35 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:36 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" returned: 0 in 1.001s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-quobyte-beca3790-ee99-4c4f-ba16-eaaa4b22be4d" released by "delete_volume" :: held 1.892s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Created reservations ['e20f1f9e-6d4c-4ad5-a856-03f3dcfbf26f', '57ea4550-90b2-4f97-b7ef-baa7f09b8f03', '37264ce5-af6a-4dd5-a1ea-4d409f874520', '28f12396-d7f1-4af7-ae21-31e73b9b7731'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:36 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:50:36 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:36 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.762s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:50:36 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Deleted volume successfully. Jul 05 19:50:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9987c66e-c396-4f71-a1d1-5f48810df1bd tempest-SnapshotDependencyTests-1871410352 None] Lock "cinder-beca3790-ee99-4c4f-ba16-eaaa4b22be4d-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Flow 'volume_create_manager' (837b8adb-1321-49a7-9599-5886f081f105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b7ae15-5dee-4140-865c-ffff5cbda2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b7ae15-5dee-4140-865c-ffff5cbda2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1738022068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df1075c-f31b-4ebb-a029-07803327df53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ef3dde2e4140e4ab742d473133d37e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:50:37Z,use_quota=True,user_id='f8712af07e71445b8fa9c49ad1efc633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df082143-b0ad-4f83-8d5b-0c1f425efc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df082143-b0ad-4f83-8d5b-0c1f425efc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a54ff75-2a15-46d5-8874-52a41b0a40bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a54ff75-2a15-46d5-8874-52a41b0a40bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df1075c-f31b-4ebb-a029-07803327df53', 'volume_name': 'volume-1df1075c-f31b-4ebb-a029-07803327df53', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d65022-bfde-4f7f-92ce-23206ad33c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d65022-bfde-4f7f-92ce-23206ad33c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370b77fc-b16f-4cb6-9d1b-7b1b062f8380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:37 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Volume 1df1075c-f31b-4ebb-a029-07803327df53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df1075c-f31b-4ebb-a029-07803327df53', 'volume_size': 1} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1738022068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df1075c-f31b-4ebb-a029-07803327df53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ef3dde2e4140e4ab742d473133d37e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:50:37Z,use_quota=True,user_id='f8712af07e71445b8fa9c49ad1efc633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Creating volume 1df1075c-f31b-4ebb-a029-07803327df53 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:50:37 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:50:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:37 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53 1073741824 Jul 05 19:50:37 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:38 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53 1073741824" returned: 0 in 1.102s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:38 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53 Jul 05 19:50:38 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:39 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53" returned: 0 in 1.108s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:39 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:50:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370b77fc-b16f-4cb6-9d1b-7b1b062f8380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df1075c-f31b-4ebb-a029-07803327df53', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017eb551-5a75-423d-b812-b7f3bede3af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:39 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Volume volume-1df1075c-f31b-4ebb-a029-07803327df53 (1df1075c-f31b-4ebb-a029-07803327df53): created successfully Jul 05 19:50:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017eb551-5a75-423d-b812-b7f3bede3af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:39 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Flow 'volume_create_manager' (837b8adb-1321-49a7-9599-5886f081f105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:50:39 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b47513fa-f7fa-4d06-9e21-1ef12a00c3ec tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Created volume successfully. Jul 05 19:50:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-60c2c22f-5133-450d-9be5-6ddcb99229bb tempest-VolumesActionsTest-1865219570 None] Acquiring lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101" by "attach_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-60c2c22f-5133-450d-9be5-6ddcb99229bb tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101" acquired by "attach_volume" :: waited 0.034s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:41 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-60c2c22f-5133-450d-9be5-6ddcb99229bb tempest-VolumesActionsTest-1865219570 None] Attaching volume 61505e4d-695b-4e7a-8ba0-6b093a46c101 to instance e9011d12-55c2-43d6-9276-b548de9a3a9f at mountpoint /dev/vdb on host None. Jul 05 19:50:41 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-60c2c22f-5133-450d-9be5-6ddcb99229bb tempest-VolumesActionsTest-1865219570 None] Attach volume completed successfully. Jul 05 19:50:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-60c2c22f-5133-450d-9be5-6ddcb99229bb tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101" released by "attach_volume" :: held 0.126s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-dc803b14-83fd-4aa4-9f87-f2e64d3378fc tempest-VolumesActionsTest-1865219570 None] Acquiring lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101-detach_volume" by "detach_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-dc803b14-83fd-4aa4-9f87-f2e64d3378fc tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:41 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-dc803b14-83fd-4aa4-9f87-f2e64d3378fc tempest-VolumesActionsTest-1865219570 None] Detaching volume 61505e4d-695b-4e7a-8ba0-6b093a46c101 from instance e9011d12-55c2-43d6-9276-b548de9a3a9f. Jul 05 19:50:41 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-dc803b14-83fd-4aa4-9f87-f2e64d3378fc tempest-VolumesActionsTest-1865219570 None] Detach volume completed successfully. Jul 05 19:50:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-dc803b14-83fd-4aa4-9f87-f2e64d3378fc tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Acquiring lock "cinder-1df1075c-f31b-4ebb-a029-07803327df53-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "cinder-1df1075c-f31b-4ebb-a029-07803327df53-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Acquiring lock "cinder-quobyte-1df1075c-f31b-4ebb-a029-07803327df53" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "cinder-quobyte-1df1075c-f31b-4ebb-a029-07803327df53" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:42 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1430f6b-6219-4d4d-9135-89da1a1978e4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:42 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53 Jul 05 19:50:42 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:43 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53" returned: 0 in 0.910s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:43 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53 Jul 05 19:50:43 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:43 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1df1075c-f31b-4ebb-a029-07803327df53" returned: 0 in 0.822s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "cinder-quobyte-1df1075c-f31b-4ebb-a029-07803327df53" released by "delete_volume" :: held 1.786s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:43 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Created reservations ['5fb789aa-7ed8-4fd5-af80-8607dffa1e93', 'cc4c1fe7-f69b-4e9e-ba7c-8e19b2110b6c', 'c25f3709-0ef6-4366-b972-e527cad91dce', '1917102e-d828-4e90-9d59-5ca1e19ac52a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:50:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:44 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:50:44 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:45 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.975s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:45 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:50:45 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Deleted volume successfully. Jul 05 19:50:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b3fd3164-6c6f-4bc5-8fbf-3d3706c2d079 tempest-VolumeQuotasNegativeTestJSON-1257347684 None] Lock "cinder-1df1075c-f31b-4ebb-a029-07803327df53-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Flow 'volume_create_manager' (71ed7fb6-5db9-417a-922c-f99499d77c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65922e-049f-4bf2-864a-f8e28d1c56b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65922e-049f-4bf2-864a-f8e28d1c56b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-591342383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d994fb-2e48-4d7e-b0d2-1341537b4982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f7c8c1380842c09a72294f40b6e10f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:50:51Z,use_quota=True,user_id='5bbb9ffa4bd545f6852cf862e279ffad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81258f74-d8f5-4e6b-982b-f3a7ea15104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81258f74-d8f5-4e6b-982b-f3a7ea15104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd8a9ed-ea54-4c0b-a687-072590b468b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd8a9ed-ea54-4c0b-a687-072590b468b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d994fb-2e48-4d7e-b0d2-1341537b4982', 'volume_name': 'volume-17d994fb-2e48-4d7e-b0d2-1341537b4982', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccf6da1-4998-4d1c-bb25-f2c23c1f18d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccf6da1-4998-4d1c-bb25-f2c23c1f18d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daef668a-2628-4549-8948-2a6e412b1b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:50 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Volume 17d994fb-2e48-4d7e-b0d2-1341537b4982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d994fb-2e48-4d7e-b0d2-1341537b4982', 'volume_size': 1} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-591342383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d994fb-2e48-4d7e-b0d2-1341537b4982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f7c8c1380842c09a72294f40b6e10f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:50:51Z,use_quota=True,user_id='5bbb9ffa4bd545f6852cf862e279ffad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Creating volume 17d994fb-2e48-4d7e-b0d2-1341537b4982 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:50:51 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:50:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:51 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 1073741824 Jul 05 19:50:51 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:51 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 1073741824" returned: 0 in 0.867s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:51 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 Jul 05 19:50:51 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:52 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982" returned: 0 in 0.635s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.516s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7b52a-4adc-49bd-9dd6-86187d02ee2f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daef668a-2628-4549-8948-2a6e412b1b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d994fb-2e48-4d7e-b0d2-1341537b4982', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f32c5e-d1c4-4053-bd66-d86f14a204ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:50:52 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Volume volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 (17d994fb-2e48-4d7e-b0d2-1341537b4982): created successfully Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f32c5e-d1c4-4053-bd66-d86f14a204ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:50:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Flow 'volume_create_manager' (71ed7fb6-5db9-417a-922c-f99499d77c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:50:52 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c6d3f5a0-a4c2-4274-94ef-eb29394d85e9 tempest-VolumesServicesTestJSON-120256799 None] Created volume successfully. Jul 05 19:50:52 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 Jul 05 19:50:52 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Acquiring lock "cinder-17d994fb-2e48-4d7e-b0d2-1341537b4982-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Lock "cinder-17d994fb-2e48-4d7e-b0d2-1341537b4982-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Acquiring lock "cinder-quobyte-17d994fb-2e48-4d7e-b0d2-1341537b4982" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Lock "cinder-quobyte-17d994fb-2e48-4d7e-b0d2-1341537b4982" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b0abc5-f394-48eb-856c-6a9c9e348f8d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:53 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 Jul 05 19:50:53 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:53 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101" returned: 0 in 0.794s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6607ba-ff30-4b99-844f-4e5e94d7543b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:53 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 Jul 05 19:50:53 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:53 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982" returned: 0 in 0.755s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:54 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982 Jul 05 19:50:54 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:54 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101" returned: 0 in 0.775s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.c29360f1-9815-49a3-9a6f-83188d89dc4b0mnx9omo.img {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:54 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.c29360f1-9815-49a3-9a6f-83188d89dc4b0mnx9omo.img Jul 05 19:50:54 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:54 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-17d994fb-2e48-4d7e-b0d2-1341537b4982" returned: 0 in 0.653s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Lock "cinder-quobyte-17d994fb-2e48-4d7e-b0d2-1341537b4982" released by "delete_volume" :: held 1.451s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Created reservations ['65490e85-9e6a-4bc0-b4ec-666ad4463f40', '6fc85715-d015-40f7-bc41-07ccc23ea043', '6881c92c-8940-4193-8fc6-3e7a4cfb8f90', 'c4553b2a-8dc6-4aad-9893-7dbf3dd59f38'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:50:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:54 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:50:54 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:50:56 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.280s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:56 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:50:56 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Deleted volume successfully. Jul 05 19:50:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-87b54bb3-031d-4cc3-afdf-fa9e1d9343fa tempest-VolumesServicesTestJSON-120256799 None] Lock "cinder-17d994fb-2e48-4d7e-b0d2-1341537b4982-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:50:59 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 05 19:50:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.c29360f1-9815-49a3-9a6f-83188d89dc4b0mnx9omo.img" returned: 0 in 5.104s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:50:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea484a-35de-4bd2-a348-6b3f3ea7be09]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:50:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:50:59 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 Jul 05 19:50:59 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:00 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101" returned: 0 in 1.022s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:00 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.c29360f1-9815-49a3-9a6f-83188d89dc4b0mnx9omo.img {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:51:00 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Converted 1024.00 MB image at 200.57 MB/s Jul 05 19:51:00 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] c29360f1-9815-49a3-9a6f-83188d89dc4b was raw, no need to convert to raw {{(pid=86389) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 05 19:51:10 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=82,cinder:SELECT=71,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:51:10 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=79,cinder:SELECT=68,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Flow 'volume_create_manager' (4400ebc4-f1fe-4ca8-bdd2-fe0a026e9d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f55a289-60d8-4547-9ab1-308e426de807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f55a289-60d8-4547-9ab1-308e426de807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1767770760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5bf381-b7f8-44f2-9f2b-8ab98de1030e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea49be9ca04cb4ab94128ba683ce44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:51:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:51:12Z,use_quota=True,user_id='c68a4f20917641f7b3b9ab7cd5ff1626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ca8eb4-049b-4c85-b956-d798d86356fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ca8eb4-049b-4c85-b956-d798d86356fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4162e00-e529-4276-b494-6a3e640bc3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4162e00-e529-4276-b494-6a3e640bc3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5bf381-b7f8-44f2-9f2b-8ab98de1030e', 'volume_name': 'volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e', 'volume_size': 2}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d58f36-5d45-4d1a-8dd0-6ff423e07398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d58f36-5d45-4d1a-8dd0-6ff423e07398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68d452a-314b-451e-b0e5-5152ca2e006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:12 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Volume 3a5bf381-b7f8-44f2-9f2b-8ab98de1030e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e', 'volume_size': 2} Jul 05 19:51:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:16 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:51:16 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:16 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.648s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:51:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.324s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Uploaded volume to glance image-id: c29360f1-9815-49a3-9a6f-83188d89dc4b. {{(pid=86389) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.283s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1767770760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5bf381-b7f8-44f2-9f2b-8ab98de1030e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ea49be9ca04cb4ab94128ba683ce44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:51:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:51:12Z,use_quota=True,user_id='c68a4f20917641f7b3b9ab7cd5ff1626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Creating volume 3a5bf381-b7f8-44f2-9f2b-8ab98de1030e {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:51:19 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:51:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e 2147483648 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:19 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e 2147483648 Jul 05 19:51:19 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:19 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-40251023-0b50-4808-885a-fb65ae0f90e9 tempest-VolumesActionsTest-1865219570 None] Copy volume to image completed successfully. Jul 05 19:51:20 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e 2147483648" returned: 0 in 0.863s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:20 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e Jul 05 19:51:20 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:21 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e" returned: 0 in 0.652s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.427s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68d452a-314b-451e-b0e5-5152ca2e006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e', 'volume_size': 2}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8798def-c16b-4f87-b36f-9cd201be5f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9062f1-8df8-48e4-91fd-3bddb0eb5b2e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:21 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Volume volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e (3a5bf381-b7f8-44f2-9f2b-8ab98de1030e): created successfully Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8798def-c16b-4f87-b36f-9cd201be5f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Flow 'volume_create_manager' (4400ebc4-f1fe-4ca8-bdd2-fe0a026e9d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:51:21 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-444dd637-2379-4714-8e2f-6d7b9fa0d959 tempest-VolumesCloneNegativeTest-1450298933 None] Created volume successfully. Jul 05 19:51:21 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 Jul 05 19:51:21 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Acquiring lock "cinder-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:22 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101" returned: 0 in 0.805s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Lock "cinder-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb9579a-54e3-4f54-91da-598c2316471e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Acquiring lock "cinder-quobyte-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Lock "cinder-quobyte-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dcaf9e-fa91-4b7a-9e2e-6e2dcc692fef]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:22 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 Jul 05 19:51:22 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:22 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e Jul 05 19:51:22 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:23 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101" returned: 0 in 0.768s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:23 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img Jul 05 19:51:23 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:23 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e" returned: 0 in 0.762s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:23 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e Jul 05 19:51:23 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:23 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e" returned: 0 in 0.747s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Lock "cinder-quobyte-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e" released by "delete_volume" :: held 1.577s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:24 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Created reservations ['e6e2ab70-a863-4f9a-928f-5f94d373dfff', '1cf8e48e-7240-45f8-a12d-383d1780e292', 'b8907379-2534-4e4e-9d5c-c6cf3a1ad93a', '5dc63cb1-b364-4117-ad32-d015fd26453b'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:51:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:51:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:51:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:24 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:51:24 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:25 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.061s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:25 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:51:25 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Deleted volume successfully. Jul 05 19:51:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-acd96f1c-457b-4a7d-9ba5-b5a9cdaa89ff tempest-VolumesCloneNegativeTest-1450298933 None] Lock "cinder-3a5bf381-b7f8-44f2-9f2b-8ab98de1030e-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:28 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img" returned: 0 in 5.121s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:28 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[220909c6-479f-4317-a0b0-099674d817b3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:28 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 Jul 05 19:51:28 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101" returned: 0 in 0.938s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:51:29 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Converted 1024.00 MB image at 199.93 MB/s Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] 25eaabc6-e60f-44ab-ac0c-076b3e586b7c was raw, converting to qcow2 {{(pid=86389) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 05 19:51:29 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6acea7-5961-4893-a8d5-c5cb64aa2072]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:29 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img Jul 05 19:51:29 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Flow 'volume_create_manager' (ce9c71c2-ed0c-4dad-a2cf-19e76f935978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69093fd4-6762-47eb-8cc2-0c4e2f954214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69093fd4-6762-47eb-8cc2-0c4e2f954214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-209183992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce36b8efada4f3b942a1b545c106f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:51:29Z,use_quota=True,user_id='14f05ee256f24af180f0036d4e455876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4dd409-6003-40db-9c38-839c1284da70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4dd409-6003-40db-9c38-839c1284da70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a99567-bc10-4682-a104-6d487a3da1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a99567-bc10-4682-a104-6d487a3da1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa', 'volume_name': 'volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf768e6a-60f8-460c-815c-d05c5be62265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf768e6a-60f8-460c-815c-d05c5be62265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a6b9bf-1c1e-4791-a524-06fb14384be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:29 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Volume b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa', 'volume_size': 1} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:29 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img" returned: 0 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:30 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img Jul 05 19:51:30 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:30 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img" returned: 1 in 0.701s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:51:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img /opt/stack/data/cinder/conversion/vol_upload_kdf8xcp7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:30 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img /opt/stack/data/cinder/conversion/vol_upload_kdf8xcp7 Jul 05 19:51:30 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:31 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img /opt/stack/data/cinder/conversion/vol_upload_kdf8xcp7" returned: 0 in 0.640s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:31 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Image conversion details: src /opt/stack/data/cinder/conversion/61505e4d-695b-4e7a-8ba0-6b093a46c101.temp_image.25eaabc6-e60f-44ab-ac0c-076b3e586b7cvxzq6yfe.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kdf8xcp7 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:51:31 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 05 19:51:31 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8d51c5-7956-4e16-80af-381020ca3727]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kdf8xcp7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:31 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kdf8xcp7 Jul 05 19:51:31 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:31 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kdf8xcp7" returned: 0 in 0.706s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.785s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Uploaded volume to glance image-id: 25eaabc6-e60f-44ab-ac0c-076b3e586b7c. {{(pid=86389) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.747s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-209183992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce36b8efada4f3b942a1b545c106f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:51:29Z,use_quota=True,user_id='14f05ee256f24af180f0036d4e455876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Creating volume b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:51:33 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:51:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:33 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa 1073741824 Jul 05 19:51:33 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d6d662ab-536b-43cc-859f-f9563f5bb356 tempest-VolumesActionsTest-1865219570 None] Copy volume to image completed successfully. Jul 05 19:51:34 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa 1073741824" returned: 0 in 0.832s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:34 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa Jul 05 19:51:34 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Acquiring lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Acquiring lock "cinder-quobyte-61505e4d-695b-4e7a-8ba0-6b093a46c101" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Lock "cinder-quobyte-61505e4d-695b-4e7a-8ba0-6b093a46c101" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[23915957-05c1-4f46-bd7b-c8b153d3c225]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:34 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 Jul 05 19:51:34 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:34 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" returned: 0 in 0.668s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a6b9bf-1c1e-4791-a524-06fb14384be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173f127e-92e1-4fbd-8e74-0fb131907879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:34 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Volume volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa (b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa): created successfully Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173f127e-92e1-4fbd-8e74-0fb131907879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Flow 'volume_create_manager' (ce9c71c2-ed0c-4dad-a2cf-19e76f935978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:51:34 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1f617cb6-c888-487f-b14d-bdf37097e067 tempest-VolumesSnapshotListTestJSON-1432445299 None] Created volume successfully. Jul 05 19:51:35 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101" returned: 0 in 0.759s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:35 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101 Jul 05 19:51:35 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Creating offline snapshot 4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 of volume b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dc524d-087a-451e-9408-ca3c3684d3f6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:35 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-61505e4d-695b-4e7a-8ba0-6b093a46c101" returned: 0 in 0.656s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Lock "cinder-quobyte-61505e4d-695b-4e7a-8ba0-6b093a46c101" released by "delete_volume" :: held 1.464s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Created reservations ['e498494a-9f68-47d8-b9a8-81457bb1da0a', 'e040cffa-fc17-44a4-ac24-e55986e042b5', 'a3817f73-c1e4-420d-9d89-3497f4a9ff0e', 'd7a2bb72-b396-4bae-9bd8-a8b716d9a1ac'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:51:35 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa Jul 05 19:51:35 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:36 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:51:36 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:36 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" returned: 0 in 0.772s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:36 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.628s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:36 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:51:36 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 1G Jul 05 19:51:36 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:36 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Deleted volume successfully. Jul 05 19:51:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f950f525-fa79-454d-8e07-4f5f2fcf8e09 tempest-VolumesActionsTest-1865219570 None] Lock "cinder-61505e4d-695b-4e7a-8ba0-6b093a46c101-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:37 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 1G" returned: 0 in 0.860s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:37 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 Jul 05 19:51:37 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:38 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" returned: 0 in 0.708s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:38 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 is being set with open permissions: ugo+rw Jul 05 19:51:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:38 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 Jul 05 19:51:38 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:38 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" returned: 0 in 0.678s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:38 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.info Jul 05 19:51:38 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:39 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.info" returned: 0 in 0.752s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:39 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.info is being set with open permissions: ugo+rw Jul 05 19:51:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:39 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.info Jul 05 19:51:39 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:40 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.info" returned: 0 in 0.676s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.536s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:40 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-405a4f9f-f1ea-4cd2-bc38-c417a407fcf2 tempest-VolumesSnapshotListTestJSON-1432445299 None] Create snapshot completed successfully Jul 05 19:51:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Creating offline snapshot ea913424-45a0-4348-a052-6cbe22ca0a0c of volume b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:51:41 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a614bd-5c21-4212-8df1-4eae75a64842]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:41 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 Jul 05 19:51:41 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:42 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" returned: 0 in 0.809s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:51:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:42 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c 1G Jul 05 19:51:42 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:42 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c 1G" returned: 0 in 0.915s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:42 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c Jul 05 19:51:42 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:43 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c" returned: 0 in 0.690s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:43 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c is being set with open permissions: ugo+rw Jul 05 19:51:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:43 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c Jul 05 19:51:43 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:44 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c" returned: 0 in 0.657s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.171s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-cc572991-0cd2-4847-81bf-ba55ef74c9e5 tempest-VolumesSnapshotListTestJSON-1432445299 None] Create snapshot completed successfully Jul 05 19:51:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Creating offline snapshot a8ece3a8-6d3e-41b8-8114-dcadc3f035dc of volume b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:51:45 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f521a9d-77ba-42ca-a40b-a0586db83935]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:45 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c Jul 05 19:51:45 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:46 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c" returned: 0 in 0.876s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:51:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:46 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc 1G Jul 05 19:51:46 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:47 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc 1G" returned: 0 in 0.874s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:47 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc Jul 05 19:51:47 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:48 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc" returned: 0 in 0.711s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:48 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc is being set with open permissions: ugo+rw Jul 05 19:51:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:48 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc Jul 05 19:51:48 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:48 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc" returned: 0 in 0.674s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.254s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5a9d2a4d-f079-4b14-9eea-d4590421a5f9 tempest-VolumesSnapshotListTestJSON-1432445299 None] Create snapshot completed successfully Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-a8ece3a8-6d3e-41b8-8114-dcadc3f035dc-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-a8ece3a8-6d3e-41b8-8114-dcadc3f035dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-quobyte-a8ece3a8-6d3e-41b8-8114-dcadc3f035dc" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-a8ece3a8-6d3e-41b8-8114-dcadc3f035dc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Deleting offline snapshot a8ece3a8-6d3e-41b8-8114-dcadc3f035dc of volume b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] snapshot_file for this snap is: volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e127df0-5db5-421b-bca6-eecd7fa5c6dc]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:50 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc Jul 05 19:51:50 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:51 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc" returned: 0 in 0.875s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:51:51 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[487d05fe-1934-4ad4-acc5-484f29b9679c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:51 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c Jul 05 19:51:51 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:51 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (93f3b1a0-15fc-41cd-b561-4129f458a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3548ce-ebfa-491d-b30a-825249eb1b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3548ce-ebfa-491d-b30a-825249eb1b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1660628364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cf87eb-eb30-4220-8522-6a36941773c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9281e4de3f439a8f421dd487ef48b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:51:52Z,use_quota=True,user_id='ab0cc56ead824d3a99824174eda530fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1ceccd-8073-4036-acc6-a17cb64b8036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1ceccd-8073-4036-acc6-a17cb64b8036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a84f32-18cd-4bd0-8b92-7ca09bd04eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a84f32-18cd-4bd0-8b92-7ca09bd04eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96cf87eb-eb30-4220-8522-6a36941773c1', 'volume_name': 'volume-96cf87eb-eb30-4220-8522-6a36941773c1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecc28e6-1e1d-4752-8f47-4eff0952d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecc28e6-1e1d-4752-8f47-4eff0952d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5763616-190f-4fb1-a6ed-2e6763e5113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:52 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Volume 96cf87eb-eb30-4220-8522-6a36941773c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96cf87eb-eb30-4220-8522-6a36941773c1', 'volume_size': 1} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1660628364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cf87eb-eb30-4220-8522-6a36941773c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9281e4de3f439a8f421dd487ef48b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:51:52Z,use_quota=True,user_id='ab0cc56ead824d3a99824174eda530fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Creating volume 96cf87eb-eb30-4220-8522-6a36941773c1 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:51:52 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:52 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 1073741824 Jul 05 19:51:52 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:52 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c" returned: 0 in 0.769s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:52 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc Jul 05 19:51:52 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:52 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 1073741824" returned: 0 in 0.838s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:52 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 Jul 05 19:51:52 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:53 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc" returned: 0 in 0.831s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:53 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc Jul 05 19:51:53 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:53 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1" returned: 0 in 0.650s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5763616-190f-4fb1-a6ed-2e6763e5113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96cf87eb-eb30-4220-8522-6a36941773c1', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9faf4b-afb1-4681-bc85-c26745ec6cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:51:53 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Volume volume-96cf87eb-eb30-4220-8522-6a36941773c1 (96cf87eb-eb30-4220-8522-6a36941773c1): created successfully Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9faf4b-afb1-4681-bc85-c26745ec6cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (93f3b1a0-15fc-41cd-b561-4129f458a56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:51:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-83e2d63a-cea8-439f-a3bd-8d7d547e93f7 tempest-VolumesSnapshotTestJSON-1858264294 None] Created volume successfully. Jul 05 19:51:53 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.a8ece3a8-6d3e-41b8-8114-dcadc3f035dc" returned: 0 in 0.647s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-a8ece3a8-6d3e-41b8-8114-dcadc3f035dc" released by "_delete_snapshot" :: held 3.207s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" released by "delete_snapshot" :: held 3.233s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Created reservations ['da877ceb-1579-4442-9dce-f1f9b29285d4', 'b85c3e14-3e89-4e31-aec2-e9edaa00cf18', 'a286ff61-3cf0-4c18-83f3-e595c3f531b4', 'ab7f0762-8283-413d-98a3-870aaaafc96b'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:51:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Delete snapshot completed successfully. Jul 05 19:51:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3a616d4c-06b8-4758-b86d-438ebd1b5585 tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-a8ece3a8-6d3e-41b8-8114-dcadc3f035dc-delete_snapshot" released by "delete_snapshot" :: held 3.356s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Creating offline snapshot a7f1b83c-6e03-445f-9878-fc52a112ed3f of volume 96cf87eb-eb30-4220-8522-6a36941773c1 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a92542-4894-467b-85a2-004a8043e94c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:54 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 Jul 05 19:51:54 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-ea913424-45a0-4348-a052-6cbe22ca0a0c-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-ea913424-45a0-4348-a052-6cbe22ca0a0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-quobyte-ea913424-45a0-4348-a052-6cbe22ca0a0c" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-ea913424-45a0-4348-a052-6cbe22ca0a0c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Deleting offline snapshot ea913424-45a0-4348-a052-6cbe22ca0a0c of volume b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] snapshot_file for this snap is: volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b8dc9c-6788-4925-bcc1-af373c6edf24]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:54 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c Jul 05 19:51:54 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:55 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1" returned: 0 in 0.743s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:55 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f 1G Jul 05 19:51:55 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:55 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c" returned: 0 in 0.756s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:51:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c015138-45e0-4abf-a9c7-460994bec645]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:55 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 Jul 05 19:51:55 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:55 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f 1G" returned: 0 in 0.805s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96cf87eb-eb30-4220-8522-6a36941773c1 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:55 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96cf87eb-eb30-4220-8522-6a36941773c1 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f Jul 05 19:51:55 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:56 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" returned: 0 in 0.752s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:51:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:56 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c Jul 05 19:51:56 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:56 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96cf87eb-eb30-4220-8522-6a36941773c1 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f" returned: 0 in 0.744s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:56 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f is being set with open permissions: ugo+rw Jul 05 19:51:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:56 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f Jul 05 19:51:56 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:57 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c" returned: 0 in 0.810s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:57 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c Jul 05 19:51:57 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:57 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f" returned: 0 in 0.656s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:57 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.info Jul 05 19:51:57 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:57 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.ea913424-45a0-4348-a052-6cbe22ca0a0c" returned: 0 in 0.652s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-ea913424-45a0-4348-a052-6cbe22ca0a0c" released by "_delete_snapshot" :: held 3.058s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" released by "delete_snapshot" :: held 3.084s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Created reservations ['634fa0ec-0f3a-4884-af10-55bf08ce733d', 'e0141793-7ec0-43d8-8733-1dc0404188b7', '647e88d5-2950-4f31-bc4b-94963b11544a', 'f635155c-a3a3-4e64-b371-3a93b23178be'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:51:57 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.info" returned: 0 in 0.668s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:57 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.info is being set with open permissions: ugo+rw Jul 05 19:51:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:58 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.info Jul 05 19:51:58 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Delete snapshot completed successfully. Jul 05 19:51:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-54a299ef-55de-44f5-9ecd-83233e2baadf tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-ea913424-45a0-4348-a052-6cbe22ca0a0c-delete_snapshot" released by "delete_snapshot" :: held 3.255s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:51:58 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.info" returned: 0 in 0.623s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.324s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:51:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-324d00ef-c40e-48da-abe3-35d04e580085 tempest-VolumesSnapshotTestJSON-1858264294 None] Create snapshot completed successfully Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-4eaa72e3-c58c-48ff-9c0c-9759f0e869d5-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-4eaa72e3-c58c-48ff-9c0c-9759f0e869d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-quobyte-4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Deleting offline snapshot 4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 of volume b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] snapshot_file for this snap is: volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e14e78-bd6d-47e0-b0ee-9427f7046648]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:59 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 Jul 05 19:51:59 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-a7f1b83c-6e03-445f-9878-fc52a112ed3f-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-a7f1b83c-6e03-445f-9878-fc52a112ed3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-96cf87eb-eb30-4220-8522-6a36941773c1" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-96cf87eb-eb30-4220-8522-6a36941773c1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-a7f1b83c-6e03-445f-9878-fc52a112ed3f" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-a7f1b83c-6e03-445f-9878-fc52a112ed3f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Deleting offline snapshot a7f1b83c-6e03-445f-9878-fc52a112ed3f of volume 96cf87eb-eb30-4220-8522-6a36941773c1 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] snapshot_file for this snap is: volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e329e31-57b7-420b-bd84-462c2b1b95c3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:59 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" returned: 0 in 0.761s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fc234a-3085-4152-bbfd-e592a0f8dcca]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:51:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:51:59 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f Jul 05 19:51:59 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:51:59 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa Jul 05 19:51:59 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:00 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f" returned: 0 in 0.785s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96cf87eb-eb30-4220-8522-6a36941773c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:52:00 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13bbcf4-a15a-4381-a2eb-c7c159108ec3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:00 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" returned: 0 in 0.796s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:00 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 Jul 05 19:52:00 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:00 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 Jul 05 19:52:00 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:01 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1" returned: 0 in 0.772s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:01 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f Jul 05 19:52:01 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:01 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" returned: 0 in 0.741s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:01 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5 Jul 05 19:52:01 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:02 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f" returned: 0 in 0.716s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:02 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f Jul 05 19:52:02 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:02 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa.4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" returned: 0 in 0.690s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-4eaa72e3-c58c-48ff-9c0c-9759f0e869d5" released by "_delete_snapshot" :: held 3.094s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" released by "delete_snapshot" :: held 3.116s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Created reservations ['5f3a5aa5-0f03-4e2e-a2b6-0f953092d46a', 'd3006514-1060-4f5c-bb5c-e66b88ea3429', 'facf6211-23ec-444f-85cb-436f5bed6dbd', '0143740f-2538-40e9-8464-17113d777512'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:52:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Delete snapshot completed successfully. Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4c6e653a-9054-4bcb-8634-5b92508edcfa tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-4eaa72e3-c58c-48ff-9c0c-9759f0e869d5-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:02 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1.a7f1b83c-6e03-445f-9878-fc52a112ed3f" returned: 0 in 0.628s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-a7f1b83c-6e03-445f-9878-fc52a112ed3f" released by "_delete_snapshot" :: held 2.991s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-96cf87eb-eb30-4220-8522-6a36941773c1" released by "delete_snapshot" :: held 3.011s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Created reservations ['db2ccd35-8632-40ba-8a6f-96315465a4a1', 'b8817b95-148a-4407-866e-1f4457fb9a0e', '9f7dbbe4-429c-4c07-84e7-17285970f936', '0d7c9718-125c-464a-8126-570975ed7e94'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:52:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Delete snapshot completed successfully. Jul 05 19:52:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ae392111-d99a-468f-9263-78f125a8ec0a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-a7f1b83c-6e03-445f-9878-fc52a112ed3f-delete_snapshot" released by "delete_snapshot" :: held 3.173s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:03 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63ad8bb-0fe0-4811-8187-d9ebe7e7a7e6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:03 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa Jul 05 19:52:03 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:04 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" returned: 0 in 0.773s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:04 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa Jul 05 19:52:04 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (59599b81-894f-4cc2-9273-846f193de45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98e9bbd-9176-4416-b6d0-e0fd7fb71c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98e9bbd-9176-4416-b6d0-e0fd7fb71c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-271763096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc596781-32fa-4254-bb01-84f4c77b6a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9281e4de3f439a8f421dd487ef48b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:04Z,use_quota=True,user_id='ab0cc56ead824d3a99824174eda530fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d42701-4659-4908-8d02-547381ab1e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d42701-4659-4908-8d02-547381ab1e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8177faa6-205a-4453-a674-b5f05a81f248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8177faa6-205a-4453-a674-b5f05a81f248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc596781-32fa-4254-bb01-84f4c77b6a2e', 'volume_name': 'volume-fc596781-32fa-4254-bb01-84f4c77b6a2e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc00a31b-7650-44f2-9965-a00890a566b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc00a31b-7650-44f2-9965-a00890a566b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560c08c5-374f-4186-a6b9-edc7403677be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:04 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Volume fc596781-32fa-4254-bb01-84f4c77b6a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc596781-32fa-4254-bb01-84f4c77b6a2e', 'volume_size': 1} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-271763096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc596781-32fa-4254-bb01-84f4c77b6a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9281e4de3f439a8f421dd487ef48b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:04Z,use_quota=True,user_id='ab0cc56ead824d3a99824174eda530fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Creating volume fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:52:04 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:04 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e 1073741824 Jul 05 19:52:04 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:04 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" returned: 0 in 0.674s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-quobyte-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa" released by "delete_volume" :: held 1.505s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Created reservations ['34ae7a63-c216-4465-9c93-3608c87e0009', '24957ce4-bd18-40c4-8f39-f68b14e68da7', '2abd8055-a5c4-4952-9f50-0596952e6a97', 'bd5ff6e4-d598-42ff-8743-c3e116b18217'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:05 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:52:05 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:05 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e 1073741824" returned: 0 in 0.821s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:05 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e Jul 05 19:52:05 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:05 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.695s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:05 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:52:05 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Deleted volume successfully. Jul 05 19:52:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-cb09dd35-791f-4452-a3d5-38ad7468038d tempest-VolumesSnapshotListTestJSON-1432445299 None] Lock "cinder-b37ce96f-a8c7-4ded-9dd7-09487a1cb8fa-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:06 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e" returned: 0 in 0.647s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560c08c5-374f-4186-a6b9-edc7403677be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc596781-32fa-4254-bb01-84f4c77b6a2e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1402d684-e3f5-45ab-b4f9-693e0ffba98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:06 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Volume volume-fc596781-32fa-4254-bb01-84f4c77b6a2e (fc596781-32fa-4254-bb01-84f4c77b6a2e): created successfully Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1402d684-e3f5-45ab-b4f9-693e0ffba98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (59599b81-894f-4cc2-9273-846f193de45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:06 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e0a2bfac-a9ed-4d04-9bf1-251cf7b57b48 tempest-VolumesSnapshotTestJSON-1858264294 None] Created volume successfully. Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Creating offline snapshot b601eab8-bb52-487d-99aa-f6506f8f0019 of volume fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab2230c-10de-44c8-9717-fde33ecd91c8]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:06 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e Jul 05 19:52:06 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:07 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e" returned: 0 in 0.751s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:07 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 1G Jul 05 19:52:07 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:08 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 1G" returned: 0 in 0.846s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc596781-32fa-4254-bb01-84f4c77b6a2e -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:08 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc596781-32fa-4254-bb01-84f4c77b6a2e -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 Jul 05 19:52:08 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:09 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc596781-32fa-4254-bb01-84f4c77b6a2e -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019" returned: 0 in 0.790s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:09 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 is being set with open permissions: ugo+rw Jul 05 19:52:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:09 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 Jul 05 19:52:09 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:09 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019" returned: 0 in 0.684s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:09 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.info Jul 05 19:52:09 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:10 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.info" returned: 0 in 0.641s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:10 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.info is being set with open permissions: ugo+rw Jul 05 19:52:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:10 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.info Jul 05 19:52:10 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:11 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.info" returned: 0 in 0.660s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.485s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:11 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=71,cinder:SELECT=67,cinder:INSERT=20,cinder:DELETE=3 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:52:11 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=67,cinder:UPDATE=61,cinder:DELETE=8,cinder:INSERT=15 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:52:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a7383439-5a43-4762-86d7-3ac0c7b1160c tempest-VolumesSnapshotTestJSON-1858264294 None] Create snapshot completed successfully Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (a50e613d-dcab-4666-bb25-5813993f21d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217f5ec3-5c15-4495-8771-ccb2aefa3e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217f5ec3-5c15-4495-8771-ccb2aefa3e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-13717335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a063a7f2-f2a5-45e3-8605-d4273e063b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9281e4de3f439a8f421dd487ef48b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b601eab8-bb52-487d-99aa-f6506f8f0019,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:12Z,use_quota=True,user_id='ab0cc56ead824d3a99824174eda530fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f018ab8f-b13e-4ae1-8f5e-182a566ea8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f018ab8f-b13e-4ae1-8f5e-182a566ea8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f45b93-a278-4f01-a83c-32ded473bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f45b93-a278-4f01-a83c-32ded473bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a063a7f2-f2a5-45e3-8605-d4273e063b3a', 'volume_name': 'volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a', 'volume_size': 2, 'snapshot_id': 'b601eab8-bb52-487d-99aa-f6506f8f0019'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909b9a11-2be6-463e-85cc-17c5d8509c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909b9a11-2be6-463e-85cc-17c5d8509c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02e2c81-8d58-4f26-a77e-88a01b08585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:12 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Volume a063a7f2-f2a5-45e3-8605-d4273e063b3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a', 'volume_size': 2, 'snapshot_id': 'b601eab8-bb52-487d-99aa-f6506f8f0019'} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-b601eab8-bb52-487d-99aa-f6506f8f0019-a063a7f2-f2a5-45e3-8605-d4273e063b3a" by "_create_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-b601eab8-bb52-487d-99aa-f6506f8f0019-a063a7f2-f2a5-45e3-8605-d4273e063b3a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Creating volume a063a7f2-f2a5-45e3-8605-d4273e063b3a from snapshot b601eab8-bb52-487d-99aa-f6506f8f0019 {{(pid=86389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-a063a7f2-f2a5-45e3-8605-d4273e063b3a" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-a063a7f2-f2a5-45e3-8605-d4273e063b3a" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] snapshot: b601eab8-bb52-487d-99aa-f6506f8f0019, volume: a063a7f2-f2a5-45e3-8605-d4273e063b3a, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed36e0-1e0f-494f-9a4a-8dd39ce91c94]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:12 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 Jul 05 19:52:12 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:13 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019" returned: 0 in 0.800s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc596781-32fa-4254-bb01-84f4c77b6a2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:52:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:52:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:52:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcd623b-3203-4e93-9e8c-ef76c54bc5a9]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:13 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e Jul 05 19:52:13 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:14 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e" returned: 0 in 0.828s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:14 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:52:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:14 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a Jul 05 19:52:14 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:52:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:16 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:52:16 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:17 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.379s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:52:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:52:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:52:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:52:19 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a" returned: 0 in 5.543s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:19 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6323a78-32fc-4849-b3f8-e4f7d2b82bf2]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:20 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e Jul 05 19:52:20 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:20 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e" returned: 0 in 0.998s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:20 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:52:20 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Converted 1024.00 MB image at 184.70 MB/s Jul 05 19:52:20 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a is being set with open permissions: ugo+rw Jul 05 19:52:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:20 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a Jul 05 19:52:20 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:21 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-a063a7f2-f2a5-45e3-8605-d4273e063b3a" released by "_copy_volume_from_snapshot" :: held 9.015s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-b601eab8-bb52-487d-99aa-f6506f8f0019-a063a7f2-f2a5-45e3-8605-d4273e063b3a" released by "_create_volume_from_snapshot" :: held 9.070s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.087s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02e2c81-8d58-4f26-a77e-88a01b08585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a', 'volume_size': 2, 'snapshot_id': 'b601eab8-bb52-487d-99aa-f6506f8f0019'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b76525-ae97-4768-b1f6-2382aaf1f784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:21 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Volume volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a (a063a7f2-f2a5-45e3-8605-d4273e063b3a): created successfully Jul 05 19:52:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b76525-ae97-4768-b1f6-2382aaf1f784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (a50e613d-dcab-4666-bb25-5813993f21d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:21 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8729e70f-cdbd-4ba0-b557-ed1eb430498a tempest-VolumesSnapshotTestJSON-1858264294 None] Created volume successfully. Jul 05 19:52:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-a063a7f2-f2a5-45e3-8605-d4273e063b3a-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-a063a7f2-f2a5-45e3-8605-d4273e063b3a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-a063a7f2-f2a5-45e3-8605-d4273e063b3a" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-a063a7f2-f2a5-45e3-8605-d4273e063b3a" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85fe281-43b7-4393-9eee-870871ab653d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:22 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a Jul 05 19:52:22 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:23 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a" returned: 0 in 0.786s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:23 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a Jul 05 19:52:23 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:24 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a063a7f2-f2a5-45e3-8605-d4273e063b3a" returned: 0 in 0.663s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-a063a7f2-f2a5-45e3-8605-d4273e063b3a" released by "delete_volume" :: held 1.492s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Created reservations ['f3081481-6ba6-4c53-b065-a1b842f9a077', 'c3d94b2c-2b53-406f-9885-9ab4df42a411', '37692d94-dbfc-4693-b55f-9ba065921fa2', '6206e116-9958-49fe-b7f6-d23bfac9bd76'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:24 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:52:24 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-b601eab8-bb52-487d-99aa-f6506f8f0019-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-b601eab8-bb52-487d-99aa-f6506f8f0019-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-fc596781-32fa-4254-bb01-84f4c77b6a2e" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-fc596781-32fa-4254-bb01-84f4c77b6a2e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-b601eab8-bb52-487d-99aa-f6506f8f0019" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-b601eab8-bb52-487d-99aa-f6506f8f0019" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Deleting offline snapshot b601eab8-bb52-487d-99aa-f6506f8f0019 of volume fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] snapshot_file for this snap is: volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:52:24 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9564290-1a76-4f0b-b13f-6b978e79f394]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:25 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.850s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:25 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:52:25 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Deleted volume successfully. Jul 05 19:52:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-46543532-a07e-47da-a2d3-c7a7b7f8bb0c tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-a063a7f2-f2a5-45e3-8605-d4273e063b3a-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:25 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 Jul 05 19:52:25 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:25 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019" returned: 0 in 0.807s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc596781-32fa-4254-bb01-84f4c77b6a2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:52:25 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2ff095-f593-4b18-a4f8-a123a35ef5c8]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:25 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e Jul 05 19:52:25 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:26 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e" returned: 0 in 0.771s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:26 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 Jul 05 19:52:26 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:27 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019" returned: 0 in 0.824s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:27 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019 Jul 05 19:52:27 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:28 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e.b601eab8-bb52-487d-99aa-f6506f8f0019" returned: 0 in 0.680s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-b601eab8-bb52-487d-99aa-f6506f8f0019" released by "_delete_snapshot" :: held 3.204s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-fc596781-32fa-4254-bb01-84f4c77b6a2e" released by "delete_snapshot" :: held 3.237s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:28 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Created reservations ['1c452cd2-eefd-4093-9432-4e35d9e9b537', '4d1a206d-ed9a-402a-bb88-49beac3264db', '56091e33-1fd3-48e0-affc-cff46044b522', '18666bfe-fea0-40f1-a8a2-8af8e5951815'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:52:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Delete snapshot completed successfully. Jul 05 19:52:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ae00b7b-5c6f-4a06-87eb-4b0d6fbac8fd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-b601eab8-bb52-487d-99aa-f6506f8f0019-delete_snapshot" released by "delete_snapshot" :: held 3.390s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-fc596781-32fa-4254-bb01-84f4c77b6a2e-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-fc596781-32fa-4254-bb01-84f4c77b6a2e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-fc596781-32fa-4254-bb01-84f4c77b6a2e" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-fc596781-32fa-4254-bb01-84f4c77b6a2e" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:29 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f2c5d2-3c4e-4fe4-b728-daff66575486]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:29 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e Jul 05 19:52:29 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:30 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e" returned: 0 in 0.816s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:30 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e Jul 05 19:52:30 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:30 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc596781-32fa-4254-bb01-84f4c77b6a2e" returned: 0 in 0.661s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:30 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-fc596781-32fa-4254-bb01-84f4c77b6a2e" released by "delete_volume" :: held 1.545s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:30 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Created reservations ['e50168ab-a94d-4c14-ae6b-4ba2e4d071df', 'bd31bde6-b001-43e0-9f7a-e10d5a85c363', '0a7ed956-5395-4e0c-87b4-171532e7703a', 'd25ed1d7-153b-4ce6-81cc-82568aafbd1f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:52:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:31 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:52:31 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:31 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.652s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:31 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:52:31 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Deleted volume successfully. Jul 05 19:52:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b632d6b-e6b2-435f-94cf-1f161c1a9048 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-fc596781-32fa-4254-bb01-84f4c77b6a2e-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (45c11a37-c797-4db8-800c-bd458e5f42ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5808f9ad-5de9-4230-b47a-626bd213fc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5808f9ad-5de9-4230-b47a-626bd213fc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1744479684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4281275e-8bbe-46f4-bab8-c39c47a07863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9281e4de3f439a8f421dd487ef48b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:32Z,use_quota=True,user_id='ab0cc56ead824d3a99824174eda530fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26394652-483a-4b6f-a40e-c4c998379d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26394652-483a-4b6f-a40e-c4c998379d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68db1081-4f7f-4e26-ae1c-c101ca16c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68db1081-4f7f-4e26-ae1c-c101ca16c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4281275e-8bbe-46f4-bab8-c39c47a07863', 'volume_name': 'volume-4281275e-8bbe-46f4-bab8-c39c47a07863', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6dce52-7e72-4f0a-8ac4-1487e4e28411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6dce52-7e72-4f0a-8ac4-1487e4e28411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa9049b-fe6b-4ee0-92b5-d9671ad8aa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:32 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Volume 4281275e-8bbe-46f4-bab8-c39c47a07863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4281275e-8bbe-46f4-bab8-c39c47a07863', 'volume_size': 1} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1744479684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4281275e-8bbe-46f4-bab8-c39c47a07863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9281e4de3f439a8f421dd487ef48b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:32Z,use_quota=True,user_id='ab0cc56ead824d3a99824174eda530fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Creating volume 4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:52:32 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:52:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:32 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 1073741824 Jul 05 19:52:32 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:32 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 1073741824" returned: 0 in 0.868s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:33 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 Jul 05 19:52:33 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:33 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863" returned: 0 in 0.668s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa9049b-fe6b-4ee0-92b5-d9671ad8aa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4281275e-8bbe-46f4-bab8-c39c47a07863', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff3fe46-f918-4966-a5be-9b5be7066428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:33 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Volume volume-4281275e-8bbe-46f4-bab8-c39c47a07863 (4281275e-8bbe-46f4-bab8-c39c47a07863): created successfully Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff3fe46-f918-4966-a5be-9b5be7066428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (45c11a37-c797-4db8-800c-bd458e5f42ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4698fd37-fa50-41d3-a196-20978a2372dd tempest-VolumesSnapshotTestJSON-1858264294 None] Created volume successfully. Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Flow 'volume_create_manager' (f1ed437b-3200-4caf-9912-18ebe928824a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3d3334-f41e-499e-bd8e-6ac2a0dc4b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3d3334-f41e-499e-bd8e-6ac2a0dc4b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1265291063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bcefdd-0ef6-4ccb-aee6-77578d154bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a7ae2bab9c4485940c3040e2b62f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:34Z,use_quota=True,user_id='98cec62e4f6e4b4da23e373a1bc940e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14296ab3-4ee9-4b2a-97b8-efa83592d6bf),volume_type_id=14296ab3-4ee9-4b2a-97b8-efa83592d6bf)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb61074-d80e-479f-b511-16778f10b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb61074-d80e-479f-b511-16778f10b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e663ce51-1bbd-413a-bd4b-de76f9b00862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e663ce51-1bbd-413a-bd4b-de76f9b00862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76bcefdd-0ef6-4ccb-aee6-77578d154bc8', 'volume_name': 'volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd56ba96-6d87-4d4d-b10c-ee079a63cf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd56ba96-6d87-4d4d-b10c-ee079a63cf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb14d181-39e2-40e8-b617-0e5362a8df76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:33 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Volume 76bcefdd-0ef6-4ccb-aee6-77578d154bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8', 'volume_size': 1} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1265291063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bcefdd-0ef6-4ccb-aee6-77578d154bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a7ae2bab9c4485940c3040e2b62f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:34Z,use_quota=True,user_id='98cec62e4f6e4b4da23e373a1bc940e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14296ab3-4ee9-4b2a-97b8-efa83592d6bf),volume_type_id=14296ab3-4ee9-4b2a-97b8-efa83592d6bf)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Creating volume 76bcefdd-0ef6-4ccb-aee6-77578d154bc8 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:52:33 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:52:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:33 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 1073741824 Jul 05 19:52:33 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Flow 'volume_create_manager' (0aa58e0f-88c6-4b95-ada1-e79002e337fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3fbcce-ff38-4f07-8c8c-79472bb5134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3fbcce-ff38-4f07-8c8c-79472bb5134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1628816061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1188c7fa-48aa-4d76-abb6-44c825f1a083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a7ae2bab9c4485940c3040e2b62f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:34Z,use_quota=True,user_id='98cec62e4f6e4b4da23e373a1bc940e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6af543e-d91a-44c4-b65d-71db461b6a85),volume_type_id=f6af543e-d91a-44c4-b65d-71db461b6a85)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cdfa6e-fccc-4510-b9c1-d63950537e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cdfa6e-fccc-4510-b9c1-d63950537e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c34095-a923-494e-ac74-747dd564a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c34095-a923-494e-ac74-747dd564a261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1188c7fa-48aa-4d76-abb6-44c825f1a083', 'volume_name': 'volume-1188c7fa-48aa-4d76-abb6-44c825f1a083', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4079f-8fa8-4bf3-9c80-a1bb171c34e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4079f-8fa8-4bf3-9c80-a1bb171c34e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010d6dc9-eb04-49f1-9045-dd836dd0e04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:34 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Volume 1188c7fa-48aa-4d76-abb6-44c825f1a083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1188c7fa-48aa-4d76-abb6-44c825f1a083', 'volume_size': 1} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Flow 'volume_create_manager' (2b22a01e-7e74-41e0-a8fd-401c6432273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57281fde-1d40-4d13-adc6-cf7bebfa161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57281fde-1d40-4d13-adc6-cf7bebfa161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-564098343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98128b7-3465-4bb3-b29a-e6e65965dc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a7ae2bab9c4485940c3040e2b62f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:35Z,use_quota=True,user_id='98cec62e4f6e4b4da23e373a1bc940e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c20c6a4f-0f6a-40d6-b6a8-c50b3382acbc),volume_type_id=c20c6a4f-0f6a-40d6-b6a8-c50b3382acbc)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc4c25b-f96e-406d-b843-8a6efaf11c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc4c25b-f96e-406d-b843-8a6efaf11c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264ba179-7601-4c87-a689-7535c7f16786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG cinder.image.glance [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Creating Keystone auth plugin from conf {{(pid=86389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 19:52:34 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 1073741824" returned: 0 in 0.954s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:34 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 Jul 05 19:52:34 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264ba179-7601-4c87-a689-7535c7f16786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f98128b7-3465-4bb3-b29a-e6e65965dc56', 'volume_name': 'volume-f98128b7-3465-4bb3-b29a-e6e65965dc56', 'volume_size': 1, 'image_id': '8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--995689602', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38a7ae2bab9c4485940c3040e2b62f86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'created_at': datetime.datetime(2026, 7, 5, 17, 52, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 52, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6ab3b7-df68-4585-a320-7a13f1821c5f/file', 'properties': {}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d2f5a2-f7c4-417f-926b-d14f5dcc76be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d2f5a2-f7c4-417f-926b-d14f5dcc76be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7250ce6a-c612-442e-b5ec-c1617275a975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:35 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Volume f98128b7-3465-4bb3-b29a-e6e65965dc56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f98128b7-3465-4bb3-b29a-e6e65965dc56', 'volume_size': 1, 'image_id': '8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--995689602', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38a7ae2bab9c4485940c3040e2b62f86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'created_at': datetime.datetime(2026, 7, 5, 17, 52, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 52, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6ab3b7-df68-4585-a320-7a13f1821c5f/file', 'properties': {}}, 'image_service': } Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Trying to clone f98128b7-3465-4bb3-b29a-e6e65965dc56 from image 8b6ab3b7-df68-4585-a320-7a13f1821c5f at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'metadata': {}}]). {{(pid=86389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 19:52:35 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8" returned: 0 in 0.706s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.261s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1628816061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1188c7fa-48aa-4d76-abb6-44c825f1a083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a7ae2bab9c4485940c3040e2b62f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:34Z,use_quota=True,user_id='98cec62e4f6e4b4da23e373a1bc940e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6af543e-d91a-44c4-b65d-71db461b6a85),volume_type_id=f6af543e-d91a-44c4-b65d-71db461b6a85)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Creating volume 1188c7fa-48aa-4d76-abb6-44c825f1a083 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:52:35 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:35 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 1073741824 Jul 05 19:52:35 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb14d181-39e2-40e8-b617-0e5362a8df76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d847de-b416-48fd-91a5-31a2af288611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:35 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Volume volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 (76bcefdd-0ef6-4ccb-aee6-77578d154bc8): created successfully Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d847de-b416-48fd-91a5-31a2af288611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Flow 'volume_create_manager' (f1ed437b-3200-4caf-9912-18ebe928824a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9e9f1e95-92e3-4a64-b68c-52aaf6985986 tempest-TestInstancesWithCinderVolumes-885701724 None] Created volume successfully. Jul 05 19:52:36 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 1073741824" returned: 0 in 0.856s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:36 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 Jul 05 19:52:36 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:37 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083" returned: 0 in 0.632s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.783s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010d6dc9-eb04-49f1-9045-dd836dd0e04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1188c7fa-48aa-4d76-abb6-44c825f1a083', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4261c88f-c0a6-4228-8329-af9dea8e172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Creating offline snapshot 04c56a63-0b20-4505-a96f-47bb8435af3b of volume 4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:52:37 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Volume volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 (1188c7fa-48aa-4d76-abb6-44c825f1a083): created successfully Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4261c88f-c0a6-4228-8329-af9dea8e172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Flow 'volume_create_manager' (0aa58e0f-88c6-4b95-ada1-e79002e337fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a99b0e5-e1d6-4d98-ba2f-2cad03347586]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:37 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e77321c0-365e-4003-a08a-8f7869c33b3b tempest-TestInstancesWithCinderVolumes-885701724 None] Created volume successfully. Jul 05 19:52:37 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 Jul 05 19:52:37 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:37 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863" returned: 0 in 0.779s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:38 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b 1G Jul 05 19:52:38 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:38 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD, size 20.69 MB, duration 3.28 sec {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 19:52:38 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Image download 20.69 MB at 6.30 MB/s Jul 05 19:52:38 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b6f493-6bf7-4de2-9f51-3f683275f090]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:38 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD Jul 05 19:52:38 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:38 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b 1G" returned: 0 in 0.809s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4281275e-8bbe-46f4-bab8-c39c47a07863 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:38 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4281275e-8bbe-46f4-bab8-c39c47a07863 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b Jul 05 19:52:38 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:39 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD" returned: 0 in 0.733s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:39 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Temporary image 8b6ab3b7-df68-4585-a320-7a13f1821c5f is fetched for user 98cec62e4f6e4b4da23e373a1bc940e5. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 19:52:39 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad82422-4648-430c-a709-5f60588372d4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:39 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD Jul 05 19:52:39 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:39 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4281275e-8bbe-46f4-bab8-c39c47a07863 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b" returned: 0 in 0.694s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:39 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b is being set with open permissions: ugo+rw Jul 05 19:52:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:39 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b Jul 05 19:52:39 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:40 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:40 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b" returned: 0 in 0.642s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:40 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.info Jul 05 19:52:40 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:40 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.info" returned: 0 in 0.639s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:40 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.info is being set with open permissions: ugo+rw Jul 05 19:52:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:40 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.info Jul 05 19:52:40 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:41 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.info" returned: 0 in 0.636s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.308s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-564098343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98128b7-3465-4bb3-b29a-e6e65965dc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a7ae2bab9c4485940c3040e2b62f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:35Z,use_quota=True,user_id='98cec62e4f6e4b4da23e373a1bc940e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c20c6a4f-0f6a-40d6-b6a8-c50b3382acbc),volume_type_id=c20c6a4f-0f6a-40d6-b6a8-c50b3382acbc)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Creating volume f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:52:41 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:52:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:41 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 1073741824 Jul 05 19:52:41 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:41 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8bdc5acb-3ee3-4641-8a2c-f32ecef5fdbc tempest-VolumesSnapshotTestJSON-1858264294 None] Create snapshot completed successfully Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (65fd1e26-581e-4425-ba28-8024050bad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890f0018-c11d-41df-88f3-c23d37959abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890f0018-c11d-41df-88f3-c23d37959abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-884773734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1b10d8-39ca-46c5-b80e-bade222a16f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9281e4de3f439a8f421dd487ef48b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=04c56a63-0b20-4505-a96f-47bb8435af3b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:52:42Z,use_quota=True,user_id='ab0cc56ead824d3a99824174eda530fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc15070-897e-4b78-9322-2cffb968fc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc15070-897e-4b78-9322-2cffb968fc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1349eabd-646c-46f9-bfd6-44d82aa9aa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:42 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1349eabd-646c-46f9-bfd6-44d82aa9aa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f1b10d8-39ca-46c5-b80e-bade222a16f8', 'volume_name': 'volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8', 'volume_size': 1, 'snapshot_id': '04c56a63-0b20-4505-a96f-47bb8435af3b'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25601077-2090-4a42-ba9c-7d7f307751c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25601077-2090-4a42-ba9c-7d7f307751c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee0331b-668c-411b-aef3-cb93a650421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:42 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Volume 0f1b10d8-39ca-46c5-b80e-bade222a16f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8', 'volume_size': 1, 'snapshot_id': '04c56a63-0b20-4505-a96f-47bb8435af3b'} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 1073741824" returned: 0 in 0.858s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:42 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 Jul 05 19:52:42 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:42 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56" returned: 0 in 0.621s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.646s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-04c56a63-0b20-4505-a96f-47bb8435af3b-0f1b10d8-39ca-46c5-b80e-bade222a16f8" by "_create_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-04c56a63-0b20-4505-a96f-47bb8435af3b-0f1b10d8-39ca-46c5-b80e-bade222a16f8" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Creating volume 0f1b10d8-39ca-46c5-b80e-bade222a16f8 from snapshot 04c56a63-0b20-4505-a96f-47bb8435af3b {{(pid=86389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-0f1b10d8-39ca-46c5-b80e-bade222a16f8" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Attempting download of 8b6ab3b7-df68-4585-a320-7a13f1821c5f ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'metadata': {}}])) to volume f98128b7-3465-4bb3-b29a-e6e65965dc56. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-0f1b10d8-39ca-46c5-b80e-bade222a16f8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] snapshot: 04c56a63-0b20-4505-a96f-47bb8435af3b, volume: 0f1b10d8-39ca-46c5-b80e-bade222a16f8, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd0a4cf-ce42-4757-af27-10e514efd361]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e841ac1-cb05-4905-b651-e8683136df4c]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6ab3b7-df68-4585-a320-7a13f1821c5f_d3ds0w9_ {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:43 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b Jul 05 19:52:43 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:43 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6ab3b7-df68-4585-a320-7a13f1821c5f_d3ds0w9_ Jul 05 19:52:43 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:43 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6ab3b7-df68-4585-a320-7a13f1821c5f_d3ds0w9_" returned: 0 in 0.709s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6ab3b7-df68-4585-a320-7a13f1821c5f_d3ds0w9_ {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:43 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b" returned: 0 in 0.743s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4281275e-8bbe-46f4-bab8-c39c47a07863(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c061aa2-ecd3-48d7-9973-ad2d31ee6485]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:43 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6ab3b7-df68-4585-a320-7a13f1821c5f_d3ds0w9_ Jul 05 19:52:43 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:43 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 Jul 05 19:52:43 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:44 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6ab3b7-df68-4585-a320-7a13f1821c5f_d3ds0w9_" returned: 1 in 0.714s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6ab3b7-df68-4585-a320-7a13f1821c5f_d3ds0w9_' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:52:44 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[02567656-97ac-4e9a-b075-b7b56dcfa0c0]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:44 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863" returned: 0 in 0.775s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:44 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:52:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:44 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD Jul 05 19:52:44 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:44 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 Jul 05 19:52:44 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:45 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD" returned: 0 in 0.747s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:45 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] 8b6ab3b7-df68-4585-a320-7a13f1821c5f was qcow2, converting to raw {{(pid=86389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 19:52:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:45 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 Jul 05 19:52:45 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:49 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56" returned: 0 in 3.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:49 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b6ab3b7-df68-4585-a320-7a13f1821c5f_wbv8ek8_devstack@QuobyteHD, size 112.00 MB, duration 3.75 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:52:49 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Converted 112.00 MB image at 29.89 MB/s Jul 05 19:52:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:49 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 1G Jul 05 19:52:49 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:49 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8" returned: 0 in 4.989s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a1736-e9d2-4840-85ba-6221d85a72bf]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:49 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 Jul 05 19:52:49 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:50 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 1G" returned: 0 in 0.958s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b7fab6-b731-418b-a724-1be7e23f132e]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:50 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 Jul 05 19:52:50 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:50 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863" returned: 0 in 0.931s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:50 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:52:50 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Converted 1024.00 MB image at 205.20 MB/s Jul 05 19:52:50 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 is being set with open permissions: ugo+rw Jul 05 19:52:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:50 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 Jul 05 19:52:50 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:50 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56" returned: 0 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:50 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 Jul 05 19:52:50 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:51 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8" returned: 0 in 0.641s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-0f1b10d8-39ca-46c5-b80e-bade222a16f8" released by "_copy_volume_from_snapshot" :: held 8.198s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-04c56a63-0b20-4505-a96f-47bb8435af3b-0f1b10d8-39ca-46c5-b80e-bade222a16f8" released by "_create_volume_from_snapshot" :: held 8.233s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.255s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee0331b-668c-411b-aef3-cb93a650421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8', 'volume_size': 1, 'snapshot_id': '04c56a63-0b20-4505-a96f-47bb8435af3b'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f9627e-7a31-422e-860e-2290f2554bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:51 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Volume volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 (0f1b10d8-39ca-46c5-b80e-bade222a16f8): created successfully Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f9627e-7a31-422e-860e-2290f2554bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Flow 'volume_create_manager' (65fd1e26-581e-4425-ba28-8024050bad1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0662818b-b489-4e0b-b3a1-47090ccb56d6 tempest-VolumesSnapshotTestJSON-1858264294 None] Created volume successfully. Jul 05 19:52:51 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56" returned: 1 in 0.725s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Downloaded image 8b6ab3b7-df68-4585-a320-7a13f1821c5f ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'metadata': {}}])) to volume f98128b7-3465-4bb3-b29a-e6e65965dc56 successfully. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Temporary image 8b6ab3b7-df68-4585-a320-7a13f1821c5f for user 98cec62e4f6e4b4da23e373a1bc940e5 is deleted. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Marking volume f98128b7-3465-4bb3-b29a-e6e65965dc56 as bootable. {{(pid=86389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Copying metadata from image 8b6ab3b7-df68-4585-a320-7a13f1821c5f to f98128b7-3465-4bb3-b29a-e6e65965dc56. {{(pid=86389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Creating volume glance metadata for volume f98128b7-3465-4bb3-b29a-e6e65965dc56 backed by image 8b6ab3b7-df68-4585-a320-7a13f1821c5f with: {'image_id': '8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'image_name': 'tempest-scenario-img--995689602', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7250ce6a-c612-442e-b5ec-c1617275a975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98128b7-3465-4bb3-b29a-e6e65965dc56', 'volume_size': 1, 'image_id': '8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--995689602', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38a7ae2bab9c4485940c3040e2b62f86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6ab3b7-df68-4585-a320-7a13f1821c5f', 'created_at': datetime.datetime(2026, 7, 5, 17, 52, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 52, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6ab3b7-df68-4585-a320-7a13f1821c5f/file', 'properties': {}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a5b0c5-d894-47d0-8d71-62a4d8eac521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:52:51 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Volume volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 (f98128b7-3465-4bb3-b29a-e6e65965dc56): created successfully Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a5b0c5-d894-47d0-8d71-62a4d8eac521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Flow 'volume_create_manager' (2b22a01e-7e74-41e0-a8fd-401c6432273c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:52:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-32fe5378-1c7d-4760-bac6-c6fc2233939c tempest-TestInstancesWithCinderVolumes-885701724 None] Created volume successfully. Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-0f1b10d8-39ca-46c5-b80e-bade222a16f8-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-0f1b10d8-39ca-46c5-b80e-bade222a16f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-0f1b10d8-39ca-46c5-b80e-bade222a16f8" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-0f1b10d8-39ca-46c5-b80e-bade222a16f8" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f468a-704e-4ca1-b00f-058d243f2de6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:52 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 Jul 05 19:52:52 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:52 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8" returned: 0 in 0.758s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:52 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8 Jul 05 19:52:52 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:53 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0f1b10d8-39ca-46c5-b80e-bade222a16f8" returned: 0 in 0.695s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-0f1b10d8-39ca-46c5-b80e-bade222a16f8" released by "delete_volume" :: held 1.497s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:53 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Created reservations ['5d8ae861-ce23-4dff-8d55-7733416c1fb0', '559fa765-883e-4705-828a-ec9be97461c2', '29806cf2-0b45-4798-b37a-ce96ef6890f7', 'baa23bd8-eb60-40f0-848e-b87b472f5530'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:52:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:52:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:52:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:52:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:53 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:52:53 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-04c56a63-0b20-4505-a96f-47bb8435af3b-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-04c56a63-0b20-4505-a96f-47bb8435af3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-4281275e-8bbe-46f4-bab8-c39c47a07863" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-4281275e-8bbe-46f4-bab8-c39c47a07863" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-04c56a63-0b20-4505-a96f-47bb8435af3b" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-04c56a63-0b20-4505-a96f-47bb8435af3b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Deleting offline snapshot 04c56a63-0b20-4505-a96f-47bb8435af3b of volume 4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] snapshot_file for this snap is: volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:52:54 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.687s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccca224e-5db0-40b7-bd95-8710bde54adf]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Deleted volume successfully. Jul 05 19:52:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-713bf087-a01a-42d6-bcea-af7b318db9b4 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-0f1b10d8-39ca-46c5-b80e-bade222a16f8-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:54 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b Jul 05 19:52:54 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:55 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b" returned: 0 in 0.802s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4281275e-8bbe-46f4-bab8-c39c47a07863(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:52:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc1428e-ff82-4f0b-8534-9678109f0831]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:55 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 Jul 05 19:52:55 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:55 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863" returned: 0 in 0.737s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:55 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b Jul 05 19:52:55 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:56 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b" returned: 0 in 0.734s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:56 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b Jul 05 19:52:56 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:57 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863.04c56a63-0b20-4505-a96f-47bb8435af3b" returned: 0 in 0.641s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-04c56a63-0b20-4505-a96f-47bb8435af3b" released by "_delete_snapshot" :: held 3.035s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-4281275e-8bbe-46f4-bab8-c39c47a07863" released by "delete_snapshot" :: held 3.067s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:57 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Created reservations ['f6a20050-b7ce-401b-9ee2-e81f92256a2b', '3af211b3-cde7-4e8c-954b-e13a7fa372cb', '091bea98-6c54-48d9-a5b5-e063ad7b5b5c', '3b00f83c-a6b4-4f58-8031-084945dbb9f9'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:52:57 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Delete snapshot completed successfully. Jul 05 19:52:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a37ffe25-835d-42fc-a84f-a2df6765eac1 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-04c56a63-0b20-4505-a96f-47bb8435af3b-delete_snapshot" released by "delete_snapshot" :: held 3.199s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:52:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-4281275e-8bbe-46f4-bab8-c39c47a07863-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-4281275e-8bbe-46f4-bab8-c39c47a07863-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-4281275e-8bbe-46f4-bab8-c39c47a07863" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:52:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-4281275e-8bbe-46f4-bab8-c39c47a07863" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:52:58 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[438d0972-3fd7-401b-9c8a-2b1dfba619f0]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:58 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 Jul 05 19:52:58 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:52:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:52:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2758d1-c9b0-4de3-ac6f-eb78ef0fba77]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:52:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:59 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 05 19:52:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863" returned: 0 in 0.837s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:52:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:52:59 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863 Jul 05 19:52:59 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:52:59 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 Jul 05 19:52:59 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:00 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4281275e-8bbe-46f4-bab8-c39c47a07863" returned: 0 in 0.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-4281275e-8bbe-46f4-bab8-c39c47a07863" released by "delete_volume" :: held 1.591s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:53:00 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56" returned: 0 in 0.792s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Created reservations ['8f9f0641-fede-4861-ab64-26882fa242af', '3a296530-41fe-475f-9d3a-3c0209dc3b44', '4e154bc0-cc18-4ef5-a6d0-328cdef77de9', '517b86f2-dfd5-45eb-a913-304981645b48'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:53:00 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 Jul 05 19:53:00 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:00 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:53:00 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-96cf87eb-eb30-4220-8522-6a36941773c1-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-96cf87eb-eb30-4220-8522-6a36941773c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "cinder-quobyte-96cf87eb-eb30-4220-8522-6a36941773c1" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-96cf87eb-eb30-4220-8522-6a36941773c1" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2912e5c-2192-4ad3-8a02-9ebf561e1106]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:00 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56" returned: 1 in 0.856s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:53:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.693s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:53:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-f98128b7-3465-4bb3-b29a-e6e65965dc56', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ca56aaa-9e5f-4c62-b92f-600df31faebd', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:53:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-8536c4cb-cc96-4034-9b59-6ad03f9109b4 req-f9ad8b39-50fb-49f0-a715-014e28ae0a99 tempest-TestInstancesWithCinderVolumes-885701724 None] attachment_update completed successfully. Jul 05 19:53:01 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:01 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 Jul 05 19:53:01 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.800s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:01 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:53:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Deleted volume successfully. Jul 05 19:53:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e8be836-1d90-4840-9082-bb69e3fe4cf8 tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-4281275e-8bbe-46f4-bab8-c39c47a07863-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:53:01 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1" returned: 0 in 0.824s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:01 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1 Jul 05 19:53:01 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:02 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96cf87eb-eb30-4220-8522-6a36941773c1" returned: 0 in 0.635s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-quobyte-96cf87eb-eb30-4220-8522-6a36941773c1" released by "delete_volume" :: held 1.524s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:53:02 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Created reservations ['b959defe-7438-48e4-ba0b-14f61626b8fa', 'c8dce180-8eff-4523-b7a8-eeda5026e6c4', 'd8546696-e985-4623-bdaf-781bd8d424bb', '4506f908-5d66-4078-817e-bae290d93840'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:53:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:53:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:53:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:53:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:53:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:53:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:02 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:53:02 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:03 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.655s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:03 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:53:03 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Deleted volume successfully. Jul 05 19:53:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-488ce614-6028-47a4-9d35-eb7a7da72afa tempest-VolumesSnapshotTestJSON-1858264294 None] Lock "cinder-96cf87eb-eb30-4220-8522-6a36941773c1-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:53:12 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=80,cinder:SELECT=61,cinder:INSERT=21,cinder:DELETE=3 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:53:13 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:DELETE=10,cinder:SELECT=67,cinder:UPDATE=64,cinder:INSERT=21 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:53:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:53:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:53:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:53:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:53:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:53:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:53:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:16 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:53:16 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:17 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.102s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:53:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:53:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:53:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Flow 'volume_create_manager' (3e850a23-9dc6-4610-9c71-c89b1e0b1cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ba608a-cfb5-4a63-9378-ba573858c7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ba608a-cfb5-4a63-9378-ba573858c7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1399708826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4de7a65-6275-45b6-abbc-7cf33ed914b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d27d345f07445b894d3fa6e564aaf2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:53:32Z,use_quota=True,user_id='5dea932bf50f4001aa2a1d2da1a3e1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc37415d-eb9a-4e0f-a900-dc60934c160d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc37415d-eb9a-4e0f-a900-dc60934c160d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d502f6-3123-45c0-a3ce-3b5f4673fc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d502f6-3123-45c0-a3ce-3b5f4673fc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4de7a65-6275-45b6-abbc-7cf33ed914b0', 'volume_name': 'volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f09bcd-420e-4e67-bb98-2a750af1c219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f09bcd-420e-4e67-bb98-2a750af1c219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e3c69b-b25e-4755-ab7d-d4c7cab38a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:53:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Volume e4de7a65-6275-45b6-abbc-7cf33ed914b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0', 'volume_size': 1} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1399708826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4de7a65-6275-45b6-abbc-7cf33ed914b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d27d345f07445b894d3fa6e564aaf2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:53:32Z,use_quota=True,user_id='5dea932bf50f4001aa2a1d2da1a3e1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Creating volume e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:53:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:53:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:53:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:53:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:53:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:53:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:53:32 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:53:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:32 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 1073741824 Jul 05 19:53:32 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:32 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 1073741824" returned: 0 in 0.909s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:32 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 Jul 05 19:53:32 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:33 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0" returned: 0 in 0.667s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:53:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:53:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e3c69b-b25e-4755-ab7d-d4c7cab38a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:53:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7877a993-d3e3-4cd5-a46a-369b337f67fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:53:33 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Volume volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 (e4de7a65-6275-45b6-abbc-7cf33ed914b0): created successfully Jul 05 19:53:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7877a993-d3e3-4cd5-a46a-369b337f67fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:53:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Flow 'volume_create_manager' (3e850a23-9dc6-4610-9c71-c89b1e0b1cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:53:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b3339bfb-fea9-4553-b588-d77bdee75a74 tempest-TestStampPattern-1299902317 None] Created volume successfully. Jul 05 19:53:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-4591c36a-b52d-4611-95f8-0eabb0d3f810 req-f02cda09-a5b6-4e4d-8634-e8cd39878340 tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:53:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-4591c36a-b52d-4611-95f8-0eabb0d3f810 req-f02cda09-a5b6-4e4d-8634-e8cd39878340 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:53:35 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a8549-a9d7-45af-a949-d0d02c9a53e5]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:53:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-4591c36a-b52d-4611-95f8-0eabb0d3f810 req-f02cda09-a5b6-4e4d-8634-e8cd39878340 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:35 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 Jul 05 19:53:35 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:35 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-4591c36a-b52d-4611-95f8-0eabb0d3f810 req-f02cda09-a5b6-4e4d-8634-e8cd39878340 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8" returned: 0 in 0.809s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-4591c36a-b52d-4611-95f8-0eabb0d3f810 req-f02cda09-a5b6-4e4d-8634-e8cd39878340 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:53:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-4591c36a-b52d-4611-95f8-0eabb0d3f810 req-f02cda09-a5b6-4e4d-8634-e8cd39878340 tempest-TestInstancesWithCinderVolumes-885701724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdd8dde4-af30-43dd-b08b-ab6e4e042e1f', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:53:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-4591c36a-b52d-4611-95f8-0eabb0d3f810 req-f02cda09-a5b6-4e4d-8634-e8cd39878340 tempest-TestInstancesWithCinderVolumes-885701724 None] attachment_update completed successfully. Jul 05 19:53:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-fc274c7f-05d8-4e4d-bf6b-f18f4fdd4198 req-74403013-c01e-41d5-9d89-519e5cd9ad09 tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:53:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-fc274c7f-05d8-4e4d-bf6b-f18f4fdd4198 req-74403013-c01e-41d5-9d89-519e5cd9ad09 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:53:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c6e0cb-80a6-4e96-b094-3de754f141af]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:53:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-fc274c7f-05d8-4e4d-bf6b-f18f4fdd4198 req-74403013-c01e-41d5-9d89-519e5cd9ad09 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:43 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 Jul 05 19:53:43 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:44 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-fc274c7f-05d8-4e4d-bf6b-f18f4fdd4198 req-74403013-c01e-41d5-9d89-519e5cd9ad09 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083" returned: 0 in 0.774s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-fc274c7f-05d8-4e4d-bf6b-f18f4fdd4198 req-74403013-c01e-41d5-9d89-519e5cd9ad09 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.792s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:53:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-fc274c7f-05d8-4e4d-bf6b-f18f4fdd4198 req-74403013-c01e-41d5-9d89-519e5cd9ad09 tempest-TestInstancesWithCinderVolumes-885701724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-1188c7fa-48aa-4d76-abb6-44c825f1a083', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cebde200-f3b7-41c5-a3bb-2ccc1b6df15f', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:53:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-fc274c7f-05d8-4e4d-bf6b-f18f4fdd4198 req-74403013-c01e-41d5-9d89-519e5cd9ad09 tempest-TestInstancesWithCinderVolumes-885701724 None] attachment_update completed successfully. Jul 05 19:53:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-a808041b-ef8f-45b3-9c55-ef8bdb591685 req-5f00bb7c-345e-4d76-ab83-07449f3722c6 tempest-TestInstancesWithCinderVolumes-885701724 None] Terminate volume connection completed successfully. Jul 05 19:53:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-a808041b-ef8f-45b3-9c55-ef8bdb591685 req-5f00bb7c-345e-4d76-ab83-07449f3722c6 tempest-TestInstancesWithCinderVolumes-885701724 None] Deleting attachment fdd8dde4-af30-43dd-b08b-ab6e4e042e1f. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:53:54 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:53:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "cinder-76bcefdd-0ef6-4ccb-aee6-77578d154bc8-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:53:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-76bcefdd-0ef6-4ccb-aee6-77578d154bc8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:53:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "cinder-quobyte-76bcefdd-0ef6-4ccb-aee6-77578d154bc8" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:53:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-quobyte-76bcefdd-0ef6-4ccb-aee6-77578d154bc8" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:53:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b0fce7-7c36-4bfd-a716-19e18ffa59ed]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:53:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:55 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 Jul 05 19:53:55 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:56 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8" returned: 0 in 0.810s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:56 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8 Jul 05 19:53:56 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:57 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-76bcefdd-0ef6-4ccb-aee6-77578d154bc8" returned: 0 in 0.785s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-quobyte-76bcefdd-0ef6-4ccb-aee6-77578d154bc8" released by "delete_volume" :: held 1.656s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:53:57 devstack cinder-volume[86389]: WARNING cinder.quota [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91714834-2144158504 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91714834-2144158504, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:53:57 devstack cinder-volume[86389]: WARNING cinder.quota [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91714834-2144158504 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91714834-2144158504, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Created reservations ['c30c3e3f-e717-46e4-9595-9a5bf66e4d61', '5a279884-9b6b-4feb-a839-5abc3a123d1f', '48a88c99-533f-4eee-9867-da8f4b546e22', '54cbca04-561a-490a-a8c2-4c4c139cee0e'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:53:57 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:53:57 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:53:57 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.646s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:53:57 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Deleted volume successfully. Jul 05 19:53:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ede40f72-1fe4-426d-ac42-527905ca674c tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-76bcefdd-0ef6-4ccb-aee6-77578d154bc8-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:53:59 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-41a7cb96-704a-431b-b14c-74a021bb415a req-c7e3d9b5-7a36-44f3-8997-412a4d4cad3d tempest-TestInstancesWithCinderVolumes-885701724 None] Terminate volume connection completed successfully. Jul 05 19:53:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-41a7cb96-704a-431b-b14c-74a021bb415a req-c7e3d9b5-7a36-44f3-8997-412a4d4cad3d tempest-TestInstancesWithCinderVolumes-885701724 None] Deleting attachment cebde200-f3b7-41c5-a3bb-2ccc1b6df15f. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:54:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "cinder-1188c7fa-48aa-4d76-abb6-44c825f1a083-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:54:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-1188c7fa-48aa-4d76-abb6-44c825f1a083-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:54:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "cinder-quobyte-1188c7fa-48aa-4d76-abb6-44c825f1a083" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:54:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-quobyte-1188c7fa-48aa-4d76-abb6-44c825f1a083" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:54:01 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b4f616-31be-424c-aa1d-8fd0fddd27ff]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:54:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:01 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 Jul 05 19:54:01 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:02 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083" returned: 0 in 0.837s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:02 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083 Jul 05 19:54:02 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:03 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1188c7fa-48aa-4d76-abb6-44c825f1a083" returned: 0 in 0.715s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-quobyte-1188c7fa-48aa-4d76-abb6-44c825f1a083" released by "delete_volume" :: held 1.598s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:54:03 devstack cinder-volume[86389]: WARNING cinder.quota [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-853746754-859203842 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-853746754-859203842, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:54:03 devstack cinder-volume[86389]: WARNING cinder.quota [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-853746754-859203842 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-853746754-859203842, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:54:03 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Created reservations ['1e204a51-1af4-4377-98c3-835a6ba6ef8d', '458fabb0-d9a0-46de-8187-11816aae0dc7', 'a615b874-0c54-4bbe-9dc5-1f2669bbb5db', 'e37303ab-bd6c-4a0c-b31e-b1ef80b17627'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:54:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:54:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:54:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:03 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:54:03 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:04 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.743s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:04 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:54:04 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Deleted volume successfully. Jul 05 19:54:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7e80d72f-ca9d-4f5a-bc9f-4e2292bcdd1a tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-1188c7fa-48aa-4d76-abb6-44c825f1a083-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:54:08 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-2af631a8-36fc-40b9-8998-9afb491caa82 req-282a6d89-f477-4c07-ad4d-d5525b87c88d tempest-TestInstancesWithCinderVolumes-885701724 None] Terminate volume connection completed successfully. Jul 05 19:54:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-2af631a8-36fc-40b9-8998-9afb491caa82 req-282a6d89-f477-4c07-ad4d-d5525b87c88d tempest-TestInstancesWithCinderVolumes-885701724 None] Deleting attachment 0ca56aaa-9e5f-4c62-b92f-600df31faebd. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:54:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "cinder-f98128b7-3465-4bb3-b29a-e6e65965dc56-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:54:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-f98128b7-3465-4bb3-b29a-e6e65965dc56-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:54:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "cinder-quobyte-f98128b7-3465-4bb3-b29a-e6e65965dc56" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:54:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-quobyte-f98128b7-3465-4bb3-b29a-e6e65965dc56" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:54:12 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4569a779-baba-45cf-8d3d-e23888f07012]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:54:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:12 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 Jul 05 19:54:12 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:12 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56" returned: 0 in 0.751s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:12 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 Jul 05 19:54:12 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-9948e4fd-8fff-4e32-a859-f26c729390ce req-93c7a693-81de-4a02-b67a-576283d61d83 tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-9948e4fd-8fff-4e32-a859-f26c729390ce req-93c7a693-81de-4a02-b67a-576283d61d83 tempest-TestStampPattern-1299902317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563ace1-d009-49bf-be98-e6d3f3e52359]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:54:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-9948e4fd-8fff-4e32-a859-f26c729390ce req-93c7a693-81de-4a02-b67a-576283d61d83 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:13 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 Jul 05 19:54:13 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:13 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56" returned: 1 in 0.753s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:54:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:13 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56 Jul 05 19:54:13 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:14 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-9948e4fd-8fff-4e32-a859-f26c729390ce req-93c7a693-81de-4a02-b67a-576283d61d83 tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0" returned: 0 in 0.781s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-9948e4fd-8fff-4e32-a859-f26c729390ce req-93c7a693-81de-4a02-b67a-576283d61d83 tempest-TestStampPattern-1299902317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-9948e4fd-8fff-4e32-a859-f26c729390ce req-93c7a693-81de-4a02-b67a-576283d61d83 tempest-TestStampPattern-1299902317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f575dda-556c-4b1c-bd46-d7972dd69272', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:54:14 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-9948e4fd-8fff-4e32-a859-f26c729390ce req-93c7a693-81de-4a02-b67a-576283d61d83 tempest-TestStampPattern-1299902317 None] attachment_update completed successfully. Jul 05 19:54:14 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f98128b7-3465-4bb3-b29a-e6e65965dc56" returned: 0 in 0.671s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-quobyte-f98128b7-3465-4bb3-b29a-e6e65965dc56" released by "delete_volume" :: held 2.236s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:54:14 devstack cinder-volume[86389]: WARNING cinder.quota [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1890622819-916188110 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1890622819-916188110, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:54:14 devstack cinder-volume[86389]: WARNING cinder.quota [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1890622819-916188110 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1890622819-916188110, it is now deprecated. Please use the default quota class for default quota. Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Created reservations ['802a2e96-5737-4c24-8fce-02c86d8af908', '186663eb-0df2-43bd-8e69-bdb75c5ce04e', '0ba7c082-c967-4229-90ec-ee719ffcb851', '8b7221be-273d-446d-a530-e4c6ea8f77c0'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:14 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:54:14 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:15 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.649s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:15 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:54:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Deleted volume successfully. Jul 05 19:54:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a1af83e7-ddc6-49e1-824e-30f3912b1221 tempest-TestInstancesWithCinderVolumes-885701724 None] Lock "cinder-f98128b7-3465-4bb3-b29a-e6e65965dc56-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:16 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:54:16 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:16 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.735s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:54:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:54:22 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-a66b6932-fef0-47a6-97d2-14b974b3de40 req-85c5cb8b-4259-4080-b092-4ec116bb61f0 tempest-TestStampPattern-1299902317 None] Terminate volume connection completed successfully. Jul 05 19:54:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-a66b6932-fef0-47a6-97d2-14b974b3de40 req-85c5cb8b-4259-4080-b092-4ec116bb61f0 tempest-TestStampPattern-1299902317 None] Deleting attachment 0f575dda-556c-4b1c-bd46-d7972dd69272. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:54:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:24 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=40,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:54:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Creating offline snapshot a4216a9c-97a5-4697-b405-d2175ec9f710 of volume e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:54:24 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5976c50b-7cfb-4060-9c65-be6499df4b39]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:54:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:24 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 Jul 05 19:54:24 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:25 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0" returned: 0 in 0.771s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:25 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 1G Jul 05 19:54:25 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:26 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 1G" returned: 0 in 0.871s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:26 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 Jul 05 19:54:26 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:27 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710" returned: 0 in 0.727s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:27 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 is being set with open permissions: ugo+rw Jul 05 19:54:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:27 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 Jul 05 19:54:27 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:27 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710" returned: 0 in 0.701s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:27 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.info Jul 05 19:54:27 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:28 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.info" returned: 0 in 0.685s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:28 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.info is being set with open permissions: ugo+rw Jul 05 19:54:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:28 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.info Jul 05 19:54:28 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:29 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.info" returned: 0 in 0.680s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.544s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4213f470-0e18-4e42-bf63-9ebdacd8c603 tempest-TestStampPattern-1299902317 None] Create snapshot completed successfully Jul 05 19:54:39 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=30,cinder:SELECT=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:54:39 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=4,cinder:DELETE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Flow 'volume_create_manager' (6c5600b0-d152-4f76-9be1-995ecde0c371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747057b9-f5fb-4b2d-b6a4-4a76543c74fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747057b9-f5fb-4b2d-b6a4-4a76543c74fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1851488860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040bbf12-e29b-49b0-b8e5-d83d11fd284a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d27d345f07445b894d3fa6e564aaf2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4216a9c-97a5-4697-b405-d2175ec9f710,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:54:40Z,use_quota=True,user_id='5dea932bf50f4001aa2a1d2da1a3e1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afc02ba-07e6-4202-a837-2e2b49cc72e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afc02ba-07e6-4202-a837-2e2b49cc72e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1271030a-3a6c-407b-bf64-58b22232c27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1271030a-3a6c-407b-bf64-58b22232c27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '040bbf12-e29b-49b0-b8e5-d83d11fd284a', 'volume_name': 'volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a', 'volume_size': 1, 'snapshot_id': 'a4216a9c-97a5-4697-b405-d2175ec9f710'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619e45b6-e115-4b1e-86fb-9f42c3524584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619e45b6-e115-4b1e-86fb-9f42c3524584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632263fd-07b5-4880-af5b-955fc33ff28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:40 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Volume 040bbf12-e29b-49b0-b8e5-d83d11fd284a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a', 'volume_size': 1, 'snapshot_id': 'a4216a9c-97a5-4697-b405-d2175ec9f710'} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Acquiring lock "cinder-quobyte-a4216a9c-97a5-4697-b405-d2175ec9f710-040bbf12-e29b-49b0-b8e5-d83d11fd284a" by "_create_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-a4216a9c-97a5-4697-b405-d2175ec9f710-040bbf12-e29b-49b0-b8e5-d83d11fd284a" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Creating volume 040bbf12-e29b-49b0-b8e5-d83d11fd284a from snapshot a4216a9c-97a5-4697-b405-d2175ec9f710 {{(pid=86389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Acquiring lock "cinder-quobyte-040bbf12-e29b-49b0-b8e5-d83d11fd284a" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-040bbf12-e29b-49b0-b8e5-d83d11fd284a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] snapshot: a4216a9c-97a5-4697-b405-d2175ec9f710, volume: 040bbf12-e29b-49b0-b8e5-d83d11fd284a, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa72dd1-d2b2-44f8-aa59-6e0e7bd7cc90]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:54:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:40 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 Jul 05 19:54:40 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:41 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710" returned: 0 in 1.026s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:54:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:54:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:54:41 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f252af-4add-43a4-94e1-8b3df1119ffa]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:54:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:41 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 Jul 05 19:54:41 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:42 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0" returned: 0 in 0.872s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:42 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:54:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:42 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a Jul 05 19:54:42 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:48 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a" returned: 0 in 6.150s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:48 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[961cf30b-410c-41e6-ba73-5a2dbd15562e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:54:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:48 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 Jul 05 19:54:48 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Flow 'volume_create_manager' (1ad87666-1b31-4da6-9f7a-43e384bc01a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0bba05-9ed5-4028-a05b-2b4115e0b7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0bba05-9ed5-4028-a05b-2b4115e0b7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1883749267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d544d91-9cf5-417b-b250-fe16d908a4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45ee3f69da34ce1992426d6270d3956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:54:49Z,use_quota=True,user_id='35e96a4efdf4425bb3cabcbc6a9aba6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22827f2c-041a-4f69-85c6-70c916376091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22827f2c-041a-4f69-85c6-70c916376091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735d3998-38ac-4331-ab1c-ec57a4944fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735d3998-38ac-4331-ab1c-ec57a4944fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d544d91-9cf5-417b-b250-fe16d908a4e2', 'volume_name': 'volume-9d544d91-9cf5-417b-b250-fe16d908a4e2', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baaf54c-7f55-42d9-b42c-b4a30a844c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baaf54c-7f55-42d9-b42c-b4a30a844c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d581b7d0-1184-472a-9531-b8d22e4506c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Volume 9d544d91-9cf5-417b-b250-fe16d908a4e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d544d91-9cf5-417b-b250-fe16d908a4e2', 'volume_size': 1} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Flow 'volume_create_manager' (4a25452b-4a1a-4101-94eb-550d74dbc43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25a5a8d-911e-44a7-9075-6031810192cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25a5a8d-911e-44a7-9075-6031810192cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2035315159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45ee3f69da34ce1992426d6270d3956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:54:50Z,use_quota=True,user_id='35e96a4efdf4425bb3cabcbc6a9aba6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f16d687-c8d9-477f-b032-3951f777bff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f16d687-c8d9-477f-b032-3951f777bff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e48249-3331-4ff1-a19b-dc7508cd278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e48249-3331-4ff1-a19b-dc7508cd278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01', 'volume_name': 'volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1a6ed1-74ff-4c52-b799-3f5fe9618498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1a6ed1-74ff-4c52-b799-3f5fe9618498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bac4f73-521c-4efe-95cc-86293b954877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:49 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Volume 31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01', 'volume_size': 1} Jul 05 19:54:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:50 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0" returned: 0 in 1.562s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:54:50 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Converted 1024.00 MB image at 166.47 MB/s Jul 05 19:54:50 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a is being set with open permissions: ugo+rw Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:50 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a Jul 05 19:54:50 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:50 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a" returned: 0 in 0.784s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-040bbf12-e29b-49b0-b8e5-d83d11fd284a" released by "_copy_volume_from_snapshot" :: held 10.551s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-a4216a9c-97a5-4697-b405-d2175ec9f710-040bbf12-e29b-49b0-b8e5-d83d11fd284a" released by "_create_volume_from_snapshot" :: held 10.610s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.634s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1883749267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d544d91-9cf5-417b-b250-fe16d908a4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45ee3f69da34ce1992426d6270d3956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:54:49Z,use_quota=True,user_id='35e96a4efdf4425bb3cabcbc6a9aba6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Creating volume 9d544d91-9cf5-417b-b250-fe16d908a4e2 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:54:50 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:54:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:50 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 1073741824 Jul 05 19:54:50 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632263fd-07b5-4880-af5b-955fc33ff28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a', 'volume_size': 1, 'snapshot_id': 'a4216a9c-97a5-4697-b405-d2175ec9f710'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c83910-5aa6-418b-9e45-1be9268b752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:51 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Volume volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a (040bbf12-e29b-49b0-b8e5-d83d11fd284a): created successfully Jul 05 19:54:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c83910-5aa6-418b-9e45-1be9268b752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Flow 'volume_create_manager' (6c5600b0-d152-4f76-9be1-995ecde0c371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:54:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fa0295cc-2c88-4ff0-a216-5dab22ff93a5 tempest-TestStampPattern-1299902317 None] Created volume successfully. Jul 05 19:54:51 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 1073741824" returned: 0 in 1.002s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:52 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 Jul 05 19:54:52 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:52 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2" returned: 0 in 0.758s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.820s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2035315159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45ee3f69da34ce1992426d6270d3956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:54:50Z,use_quota=True,user_id='35e96a4efdf4425bb3cabcbc6a9aba6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Creating volume 31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:54:52 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:52 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 1073741824 Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d581b7d0-1184-472a-9531-b8d22e4506c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d544d91-9cf5-417b-b250-fe16d908a4e2', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:52 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5cecdf-a8a4-40af-a88b-1d987c45a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:52 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Volume volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 (9d544d91-9cf5-417b-b250-fe16d908a4e2): created successfully Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5cecdf-a8a4-40af-a88b-1d987c45a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Flow 'volume_create_manager' (1ad87666-1b31-4da6-9f7a-43e384bc01a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:54:52 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9c7ecf37-bb3f-4a34-adc9-04297c8b909e tempest-TestServerVolumeAttachmentScenario-179333339 None] Created volume successfully. Jul 05 19:54:53 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 1073741824" returned: 0 in 0.975s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:54:53 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 Jul 05 19:54:53 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:54:54 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 05 19:54:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01" returned: 0 in 0.823s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:54:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:54:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:54:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bac4f73-521c-4efe-95cc-86293b954877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b595e6dc-636e-49aa-b9ba-facf57318fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:54:54 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Volume volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 (31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01): created successfully Jul 05 19:54:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b595e6dc-636e-49aa-b9ba-facf57318fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:54:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Flow 'volume_create_manager' (4a25452b-4a1a-4101-94eb-550d74dbc43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:54:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-aededd3b-0ac0-458e-a408-f93e9913bd41 tempest-TestServerVolumeAttachmentScenario-179333339 None] Created volume successfully. Jul 05 19:55:09 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:55:09 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:55:16 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:55:16 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:55:16 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.665s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:55:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:55:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-4cb93ce7-43fe-47b1-9dc5-7180ad8c98f5 req-1e094e03-1131-4512-8adb-673ca4be9e19 tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:55:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-4cb93ce7-43fe-47b1-9dc5-7180ad8c98f5 req-1e094e03-1131-4512-8adb-673ca4be9e19 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:55:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[537b94a0-b025-462f-9f19-99ea4bcb7a8c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:55:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-4cb93ce7-43fe-47b1-9dc5-7180ad8c98f5 req-1e094e03-1131-4512-8adb-673ca4be9e19 tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:55:33 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 Jul 05 19:55:33 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:55:33 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 05 19:55:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-4cb93ce7-43fe-47b1-9dc5-7180ad8c98f5 req-1e094e03-1131-4512-8adb-673ca4be9e19 tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2" returned: 0 in 0.757s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:55:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-4cb93ce7-43fe-47b1-9dc5-7180ad8c98f5 req-1e094e03-1131-4512-8adb-673ca4be9e19 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:55:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-4cb93ce7-43fe-47b1-9dc5-7180ad8c98f5 req-1e094e03-1131-4512-8adb-673ca4be9e19 tempest-TestServerVolumeAttachmentScenario-179333339 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-9d544d91-9cf5-417b-b250-fe16d908a4e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '652b3035-4285-41e2-bcff-25f3513bf489', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:55:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-4cb93ce7-43fe-47b1-9dc5-7180ad8c98f5 req-1e094e03-1131-4512-8adb-673ca4be9e19 tempest-TestServerVolumeAttachmentScenario-179333339 None] attachment_update completed successfully. Jul 05 19:55:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-73fac0c6-e83a-402c-bf12-d95d64155d40 req-cafd09c5-ffe2-4956-bebd-bab697d691eb tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:55:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-73fac0c6-e83a-402c-bf12-d95d64155d40 req-cafd09c5-ffe2-4956-bebd-bab697d691eb tempest-TestStampPattern-1299902317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:55:39 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e326dd59-2360-413b-8bb6-cc748f619085]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:55:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-73fac0c6-e83a-402c-bf12-d95d64155d40 req-cafd09c5-ffe2-4956-bebd-bab697d691eb tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:55:39 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a Jul 05 19:55:39 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:55:40 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 05 19:55:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-73fac0c6-e83a-402c-bf12-d95d64155d40 req-cafd09c5-ffe2-4956-bebd-bab697d691eb tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a" returned: 0 in 0.753s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:55:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-73fac0c6-e83a-402c-bf12-d95d64155d40 req-cafd09c5-ffe2-4956-bebd-bab697d691eb tempest-TestStampPattern-1299902317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.772s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:55:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-73fac0c6-e83a-402c-bf12-d95d64155d40 req-cafd09c5-ffe2-4956-bebd-bab697d691eb tempest-TestStampPattern-1299902317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d6cfa4d-31af-4750-bc5d-05c76e5e763a', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:55:40 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-73fac0c6-e83a-402c-bf12-d95d64155d40 req-cafd09c5-ffe2-4956-bebd-bab697d691eb tempest-TestStampPattern-1299902317 None] attachment_update completed successfully. Jul 05 19:55:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1a3a2f37-967f-440d-80dd-982d3c3d0164 req-63c8dc36-6f54-4a5a-81fc-1579026ac0fd tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:55:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1a3a2f37-967f-440d-80dd-982d3c3d0164 req-63c8dc36-6f54-4a5a-81fc-1579026ac0fd tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:55:42 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc387320-ab38-491b-8e83-225f2812a094]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:55:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-1a3a2f37-967f-440d-80dd-982d3c3d0164 req-63c8dc36-6f54-4a5a-81fc-1579026ac0fd tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:55:42 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 Jul 05 19:55:42 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:55:43 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Jul 05 19:55:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [req-1a3a2f37-967f-440d-80dd-982d3c3d0164 req-63c8dc36-6f54-4a5a-81fc-1579026ac0fd tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01" returned: 0 in 0.779s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:55:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [req-1a3a2f37-967f-440d-80dd-982d3c3d0164 req-63c8dc36-6f54-4a5a-81fc-1579026ac0fd tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.798s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:55:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-1a3a2f37-967f-440d-80dd-982d3c3d0164 req-63c8dc36-6f54-4a5a-81fc-1579026ac0fd tempest-TestServerVolumeAttachmentScenario-179333339 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90', 'name': 'volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3614c44e-0e29-4ae5-aa1f-4676bbe71cd0', 'enforce_multipath': True} {{(pid=86389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 19:55:43 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-1a3a2f37-967f-440d-80dd-982d3c3d0164 req-63c8dc36-6f54-4a5a-81fc-1579026ac0fd tempest-TestServerVolumeAttachmentScenario-179333339 None] attachment_update completed successfully. Jul 05 19:55:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-73f93d98-efe3-4d60-befd-85a74800406b req-4ba2ada0-88c0-446a-a482-9d3e0cf1b6b0 tempest-TestStampPattern-1299902317 None] Terminate volume connection completed successfully. Jul 05 19:55:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-73f93d98-efe3-4d60-befd-85a74800406b req-4ba2ada0-88c0-446a-a482-9d3e0cf1b6b0 tempest-TestStampPattern-1299902317 None] Deleting attachment 7d6cfa4d-31af-4750-bc5d-05c76e5e763a. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:55:49 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-4d68e192-b3b5-4be1-b99d-fc6c27504e6f req-0ec424ae-4d12-451c-ab69-e0c10f4f3f59 tempest-TestServerVolumeAttachmentScenario-179333339 None] Terminate volume connection completed successfully. Jul 05 19:55:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-4d68e192-b3b5-4be1-b99d-fc6c27504e6f req-0ec424ae-4d12-451c-ab69-e0c10f4f3f59 tempest-TestServerVolumeAttachmentScenario-179333339 None] Deleting attachment 3614c44e-0e29-4ae5-aa1f-4676bbe71cd0. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:55:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [req-69e17cb8-cce9-437d-ab05-84535993c9a2 req-1905a362-81de-4cd8-aa6b-f885c00c688a tempest-TestServerVolumeAttachmentScenario-179333339 None] Terminate volume connection completed successfully. Jul 05 19:55:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [req-69e17cb8-cce9-437d-ab05-84535993c9a2 req-1905a362-81de-4cd8-aa6b-f885c00c688a tempest-TestServerVolumeAttachmentScenario-179333339 None] Deleting attachment 652b3035-4285-41e2-bcff-25f3513bf489. {{(pid=86389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 19:55:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Acquiring lock "cinder-040bbf12-e29b-49b0-b8e5-d83d11fd284a-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:55:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Lock "cinder-040bbf12-e29b-49b0-b8e5-d83d11fd284a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:55:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Acquiring lock "cinder-quobyte-040bbf12-e29b-49b0-b8e5-d83d11fd284a" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:55:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-040bbf12-e29b-49b0-b8e5-d83d11fd284a" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:55:57 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca9757c-faa5-4a8a-a63c-598a7a66b8e3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:55:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:55:57 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a Jul 05 19:55:57 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:55:58 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 05 19:55:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a" returned: 0 in 0.841s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:55:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:55:58 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a Jul 05 19:55:58 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:55:58 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jul 05 19:55:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-040bbf12-e29b-49b0-b8e5-d83d11fd284a" returned: 0 in 0.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-040bbf12-e29b-49b0-b8e5-d83d11fd284a" released by "delete_volume" :: held 1.567s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Created reservations ['399434b4-f7ef-4e4f-b1ed-3d6450811eab', 'ebbc60de-578f-461e-abc0-47c84615ae29', 'c2ec9345-eee8-4293-96a5-0928f3ab6f42', 'fbe0345e-2972-415b-82f5-2b73644900b8'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:55:59 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:55:59 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:55:59 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.649s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:55:59 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Deleted volume successfully. Jul 05 19:55:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5daa1e64-6f84-4d3d-a006-48798fd2c4d7 tempest-TestStampPattern-1299902317 None] Lock "cinder-040bbf12-e29b-49b0-b8e5-d83d11fd284a-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Acquiring lock "cinder-a4216a9c-97a5-4697-b405-d2175ec9f710-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Lock "cinder-a4216a9c-97a5-4697-b405-d2175ec9f710-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Acquiring lock "cinder-quobyte-e4de7a65-6275-45b6-abbc-7cf33ed914b0" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-e4de7a65-6275-45b6-abbc-7cf33ed914b0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Acquiring lock "cinder-quobyte-a4216a9c-97a5-4697-b405-d2175ec9f710" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-a4216a9c-97a5-4697-b405-d2175ec9f710" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Deleting offline snapshot a4216a9c-97a5-4697-b405-d2175ec9f710 of volume e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] snapshot_file for this snap is: volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3079d81f-c2a3-4b5d-9e16-a4b9a8da38d3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:00 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 Jul 05 19:56:00 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:01 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710" returned: 0 in 0.768s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:56:01 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[73363215-42e7-417a-974c-16d722041b30]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:01 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 Jul 05 19:56:01 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:01 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0" returned: 0 in 0.754s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:01 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 Jul 05 19:56:01 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:02 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710" returned: 0 in 0.765s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:02 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710 Jul 05 19:56:02 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:03 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0.a4216a9c-97a5-4697-b405-d2175ec9f710" returned: 0 in 0.674s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-a4216a9c-97a5-4697-b405-d2175ec9f710" released by "_delete_snapshot" :: held 3.089s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-e4de7a65-6275-45b6-abbc-7cf33ed914b0" released by "delete_snapshot" :: held 3.113s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Created reservations ['fb778e52-397c-48a5-94ed-024563516fba', '0fbdf472-7653-44d3-937d-9ba7247ed778', 'debbd8f2-3236-4545-8df0-aba228372890', 'c345bc7e-3c7a-4267-9ba8-82da7c1248f2'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:03 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Delete snapshot completed successfully. Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7f96a97-7a45-4c72-86a3-63cfe47990dc tempest-TestStampPattern-1299902317 None] Lock "cinder-a4216a9c-97a5-4697-b405-d2175ec9f710-delete_snapshot" released by "delete_snapshot" :: held 3.263s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "cinder-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "cinder-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "cinder-quobyte-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "cinder-quobyte-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[71924906-0ea1-4209-9c46-a3b5543bc251]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:03 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 Jul 05 19:56:03 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:04 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01" returned: 0 in 0.732s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:04 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01 Jul 05 19:56:04 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:04 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01" returned: 0 in 0.708s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "cinder-quobyte-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01" released by "delete_volume" :: held 1.493s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Created reservations ['f810a23b-8cf2-4269-ad78-13088de0766c', '53dba01c-e461-4927-92e2-7df71d023b99', 'b7a1b163-fe9b-40c0-886a-385318f30cf8', 'e489e31e-521b-40e6-89b8-2fb104d936bb'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:05 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:05 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "cinder-9d544d91-9cf5-417b-b250-fe16d908a4e2-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "cinder-9d544d91-9cf5-417b-b250-fe16d908a4e2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "cinder-quobyte-9d544d91-9cf5-417b-b250-fe16d908a4e2" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "cinder-quobyte-9d544d91-9cf5-417b-b250-fe16d908a4e2" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f429c1-0743-4933-a128-c672aa416d19]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:05 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.718s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:05 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Deleted volume successfully. Jul 05 19:56:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f1e69459-a986-4ef2-9e54-352f91f1781c tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "cinder-31ea8c88-4fe0-42a0-ab1f-6dbc9a6d2b01-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:05 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 Jul 05 19:56:05 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:06 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2" returned: 0 in 0.780s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:06 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2 Jul 05 19:56:06 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:07 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9d544d91-9cf5-417b-b250-fe16d908a4e2" returned: 0 in 0.779s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "cinder-quobyte-9d544d91-9cf5-417b-b250-fe16d908a4e2" released by "delete_volume" :: held 1.609s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:07 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Created reservations ['f1e9e8ea-c4c6-4215-9c6f-689c78bafd24', '19e0b3b3-1ff2-410f-8d48-6704d395aed7', '7fcb17fb-d410-42c9-a3c5-19392fb53c1d', '298c5679-ca12-48f7-a6e8-f7c93e291ed5'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:07 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:07 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:08 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.743s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:08 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:08 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Deleted volume successfully. Jul 05 19:56:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed860f8d-0b1e-41c0-9118-ea21ef63b7f8 tempest-TestServerVolumeAttachmentScenario-179333339 None] Lock "cinder-9d544d91-9cf5-417b-b250-fe16d908a4e2-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Acquiring lock "cinder-e4de7a65-6275-45b6-abbc-7cf33ed914b0-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Lock "cinder-e4de7a65-6275-45b6-abbc-7cf33ed914b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Acquiring lock "cinder-quobyte-e4de7a65-6275-45b6-abbc-7cf33ed914b0" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-e4de7a65-6275-45b6-abbc-7cf33ed914b0" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:14 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d36fa3-8ae8-4401-a259-99c1b2c4b6af]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:14 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 Jul 05 19:56:14 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:14 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0" returned: 0 in 0.830s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:14 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0 Jul 05 19:56:14 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:15 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4de7a65-6275-45b6-abbc-7cf33ed914b0" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Lock "cinder-quobyte-e4de7a65-6275-45b6-abbc-7cf33ed914b0" released by "delete_volume" :: held 1.590s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:15 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Created reservations ['f6f67d7e-9b4e-44f1-8872-d18b4a096a12', '3c5c1062-90f7-41cc-a508-ff8e3929bd52', '42e373c5-cfae-44af-8b52-d4cdc99c8885', 'f452dbea-8dfa-4f8c-97cd-24ccf45a11a7'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:15 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:15 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:16 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:16 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:16 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.702s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:16 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Deleted volume successfully. Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-153cf06b-52e2-48d2-bd8c-bb9c9355c988 tempest-TestStampPattern-1299902317 None] Lock "cinder-e4de7a65-6275-45b6-abbc-7cf33ed914b0-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:16 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.798s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (8caee5af-004c-412d-9bde-ace6a518adc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd1b976-6eae-4e2f-9563-3eb125e6a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd1b976-6eae-4e2f-9563-3eb125e6a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-770879189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6431ba8-0463-4296-9dbe-b0cd8255dc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:18Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07ffd31-02f4-429c-a20c-00e92427071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07ffd31-02f4-429c-a20c-00e92427071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed96948-d285-4b4a-9beb-af36bd454352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed96948-d285-4b4a-9beb-af36bd454352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6431ba8-0463-4296-9dbe-b0cd8255dc0e', 'volume_name': 'volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef5fa59-0367-46c7-98cb-3331a06c5c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef5fa59-0367-46c7-98cb-3331a06c5c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2f55f8-3b0b-462b-8934-592c126c54e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Volume b6431ba8-0463-4296-9dbe-b0cd8255dc0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e', 'volume_size': 1} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-770879189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6431ba8-0463-4296-9dbe-b0cd8255dc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:18Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Creating volume b6431ba8-0463-4296-9dbe-b0cd8255dc0e {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:18 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:18 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e 1073741824 Jul 05 19:56:18 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (d592b509-c94c-4349-ad08-aeea92249650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf1a1b8-f150-4318-b33f-1cc35b5a834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf1a1b8-f150-4318-b33f-1cc35b5a834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1099569995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbd1649-6e25-4b06-807e-0c1349fba609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:18Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e77fd6-b357-4a12-a987-c22b26652302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e77fd6-b357-4a12-a987-c22b26652302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf9f9b4-90dd-4f2e-abc1-0a5441888c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf9f9b4-90dd-4f2e-abc1-0a5441888c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efbd1649-6e25-4b06-807e-0c1349fba609', 'volume_name': 'volume-efbd1649-6e25-4b06-807e-0c1349fba609', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9546339-0a52-4766-a443-4a0cb66c9ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9546339-0a52-4766-a443-4a0cb66c9ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d12db1-4460-4527-8e33-77f7ee9ff5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Volume efbd1649-6e25-4b06-807e-0c1349fba609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efbd1649-6e25-4b06-807e-0c1349fba609', 'volume_size': 1} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (f9a82fbb-cde1-4df1-94b0-fc7e5dbf7de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e3eb39-d189-4dd9-af0b-f2af1cfcd679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e3eb39-d189-4dd9-af0b-f2af1cfcd679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1606597102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1803ce33-5d7c-4b47-a037-ca86ae6d948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:19Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd4082e-a0f5-4477-bb9b-43bfc641ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd4082e-a0f5-4477-bb9b-43bfc641ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d486064a-1033-4cf9-b8aa-e93317b82102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d486064a-1033-4cf9-b8aa-e93317b82102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1803ce33-5d7c-4b47-a037-ca86ae6d948a', 'volume_name': 'volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a886ce-a38b-4998-a5f2-371c215aecbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a886ce-a38b-4998-a5f2-371c215aecbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9949de2-b0b4-4503-9f81-50e7791f2831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:18 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Volume 1803ce33-5d7c-4b47-a037-ca86ae6d948a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a', 'volume_size': 1} Jul 05 19:56:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (6ae1685c-b205-43c9-bc1f-1b1883b26b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ed0a1e-3f7b-4b57-8509-664c79aaec01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ed0a1e-3f7b-4b57-8509-664c79aaec01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1446886190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:19Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656d3188-7a35-44a8-86a7-6200cc78c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656d3188-7a35-44a8-86a7-6200cc78c758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d69ac8c-6231-4711-aeae-c9d5062a29aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d69ac8c-6231-4711-aeae-c9d5062a29aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4', 'volume_name': 'volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ff1410-8762-4327-9ef9-2325126873eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ff1410-8762-4327-9ef9-2325126873eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4140961e-b84d-4497-b106-ef8ee0a04693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Volume b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4', 'volume_size': 1} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e 1073741824" returned: 0 in 1.185s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:19 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e Jul 05 19:56:19 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (babe0ebd-12bb-4da7-8d14-1d2f4ec02feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab6314b-5423-4c1e-aa52-ba291f387130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab6314b-5423-4c1e-aa52-ba291f387130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-274094943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdcdfe1-105b-4819-99a5-67a3d7e356eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:19Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8b03f8-0d38-4219-aed0-3dfea3297afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8b03f8-0d38-4219-aed0-3dfea3297afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e485e027-cb19-4218-8e85-7fb06fd0a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e485e027-cb19-4218-8e85-7fb06fd0a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cdcdfe1-105b-4819-99a5-67a3d7e356eb', 'volume_name': 'volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7fe42b-b0ba-4f75-8fce-9076b0ecda88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7fe42b-b0ba-4f75-8fce-9076b0ecda88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe12963-5712-4891-be68-487afd84d113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:19 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Volume 1cdcdfe1-105b-4819-99a5-67a3d7e356eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb', 'volume_size': 1} Jul 05 19:56:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:20 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e" returned: 0 in 0.770s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.533s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1099569995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbd1649-6e25-4b06-807e-0c1349fba609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:18Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Creating volume efbd1649-6e25-4b06-807e-0c1349fba609 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:20 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2f55f8-3b0b-462b-8934-592c126c54e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:20 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609 1073741824 Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d87033-ce85-42ff-a6c5-30972a5d020e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:20 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:20 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Volume volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e (b6431ba8-0463-4296-9dbe-b0cd8255dc0e): created successfully Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d87033-ce85-42ff-a6c5-30972a5d020e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (8caee5af-004c-412d-9bde-ace6a518adc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-36790a01-c300-4940-a4a8-0748dd5d078a tempest-CreateVolumesFromImageTest-1518149244 None] Created volume successfully. Jul 05 19:56:20 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609 1073741824" returned: 0 in 0.944s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:21 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609 Jul 05 19:56:21 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:21 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609" returned: 0 in 0.696s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.855s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1606597102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1803ce33-5d7c-4b47-a037-ca86ae6d948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:19Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Creating volume 1803ce33-5d7c-4b47-a037-ca86ae6d948a {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:21 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:21 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a 1073741824 Jul 05 19:56:21 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d12db1-4460-4527-8e33-77f7ee9ff5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efbd1649-6e25-4b06-807e-0c1349fba609', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d911c99c-8627-4b63-95af-4c0a247f7062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:21 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Volume volume-efbd1649-6e25-4b06-807e-0c1349fba609 (efbd1649-6e25-4b06-807e-0c1349fba609): created successfully Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d911c99c-8627-4b63-95af-4c0a247f7062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (d592b509-c94c-4349-ad08-aeea92249650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:21 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d0f97bdf-5e7a-43d3-8b78-afbbbe8e686c tempest-CreateVolumesFromImageTest-1518149244 None] Created volume successfully. Jul 05 19:56:22 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a 1073741824" returned: 0 in 0.856s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:22 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a Jul 05 19:56:22 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:23 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a" returned: 0 in 0.702s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.099s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1446886190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:19Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Creating volume b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:23 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9949de2-b0b4-4503-9f81-50e7791f2831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:23 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 1073741824 Jul 05 19:56:23 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4820c93-19cc-48c5-8c03-dfe4e2976f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:23 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Volume volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a (1803ce33-5d7c-4b47-a037-ca86ae6d948a): created successfully Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4820c93-19cc-48c5-8c03-dfe4e2976f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (f9a82fbb-cde1-4df1-94b0-fc7e5dbf7de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-41120e93-73f2-401d-804d-010fb899eeb3 tempest-CreateVolumesFromImageTest-1518149244 None] Created volume successfully. Jul 05 19:56:24 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 1073741824" returned: 0 in 0.962s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:24 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 Jul 05 19:56:24 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:25 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4" returned: 0 in 0.690s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.401s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-274094943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdcdfe1-105b-4819-99a5-67a3d7e356eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4305dbaa24ec417c9a999d278a8548aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:19Z,use_quota=True,user_id='099ed52e46af4f47a71cc526bfb4cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Creating volume 1cdcdfe1-105b-4819-99a5-67a3d7e356eb {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:25 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:25 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb 1073741824 Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4140961e-b84d-4497-b106-ef8ee0a04693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:25 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a881452-9e40-4798-88fa-54e5ea2d267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:25 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Volume volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 (b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4): created successfully Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a881452-9e40-4798-88fa-54e5ea2d267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (6ae1685c-b205-43c9-bc1f-1b1883b26b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:25 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-686fe7e8-9a45-45a3-96c4-75b688e9b6af tempest-CreateVolumesFromImageTest-1518149244 None] Created volume successfully. Jul 05 19:56:25 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb 1073741824" returned: 0 in 0.903s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:25 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb Jul 05 19:56:25 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:26 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb" returned: 0 in 0.668s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe12963-5712-4891-be68-487afd84d113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a92c12-46ca-42fc-9c87-c903fa8ad433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:26 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Volume volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb (1cdcdfe1-105b-4819-99a5-67a3d7e356eb): created successfully Jul 05 19:56:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a92c12-46ca-42fc-9c87-c903fa8ad433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Flow 'volume_create_manager' (babe0ebd-12bb-4da7-8d14-1d2f4ec02feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0de38586-9e0f-4d53-9c3d-6dc1a2cd428d tempest-CreateVolumesFromImageTest-1518149244 None] Created volume successfully. Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-1cdcdfe1-105b-4819-99a5-67a3d7e356eb-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-1cdcdfe1-105b-4819-99a5-67a3d7e356eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-quobyte-1cdcdfe1-105b-4819-99a5-67a3d7e356eb" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-1cdcdfe1-105b-4819-99a5-67a3d7e356eb" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce512285-4614-410c-9932-c4c41b05bb21]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:27 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb Jul 05 19:56:27 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (3ca67a8a-ca4e-491d-99fc-231a2aa8daaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64d6d03-2980-4c8d-91c4-6f065403b0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64d6d03-2980-4c8d-91c4-6f065403b0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1294672563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:28Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139dd720-b709-4130-b496-d663f4f3c8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139dd720-b709-4130-b496-d663f4f3c8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89983632-0640-4ed8-bc5e-7a96baebce47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89983632-0640-4ed8-bc5e-7a96baebce47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7', 'volume_name': 'volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d5cb0c-4d4f-495d-94dd-61f54c01a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d5cb0c-4d4f-495d-94dd-61f54c01a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814d9080-60d3-40aa-acda-01cba36cc718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:27 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7', 'volume_size': 1} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1294672563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:28Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Creating volume c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:27 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:27 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 1073741824 Jul 05 19:56:27 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:28 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb" returned: 0 in 0.786s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:28 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb Jul 05 19:56:28 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:28 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 1073741824" returned: 0 in 0.842s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:28 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 Jul 05 19:56:28 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:28 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1cdcdfe1-105b-4819-99a5-67a3d7e356eb" returned: 0 in 0.708s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-1cdcdfe1-105b-4819-99a5-67a3d7e356eb" released by "delete_volume" :: held 1.537s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Created reservations ['561c6229-ef49-4189-848b-4cef638cf27a', '842a996a-a516-4f0f-9c0a-a34d668f4ba8', '49193fae-8e70-4410-a7a1-9810bff64b36', '634a9100-89f5-47fc-ad56-2e6d3a52eba9'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:29 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:29 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:29 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7" returned: 0 in 0.644s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=56,cinder:UPDATE=70,cinder:INSERT=12,cinder:DELETE=6 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814d9080-60d3-40aa-acda-01cba36cc718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142b19c4-157e-4b84-9b29-2d7c9f2ff511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=68,cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:56:29 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 (c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7): created successfully Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142b19c4-157e-4b84-9b29-2d7c9f2ff511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (3ca67a8a-ca4e-491d-99fc-231a2aa8daaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a4f18dda-1694-4148-a219-cc06420d90ab tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created volume successfully. Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-quobyte-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4" acquired by "delete_volume" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faa8812-eeef-4d22-955e-4ec82f690099]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:29 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.684s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Deleted volume successfully. Jul 05 19:56:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a62a94ec-8f61-4fa3-b08f-cb17c4bb82d7 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-1cdcdfe1-105b-4819-99a5-67a3d7e356eb-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:29 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 Jul 05 19:56:29 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (b550213a-708b-4936-bd30-c4127ee28d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647d7dfc-f884-4872-80c9-ce36d9f0aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647d7dfc-f884-4872-80c9-ce36d9f0aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781509148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1621aab2-e3ee-49e5-838d-3d3dd199d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:30Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0400484f-4621-4b51-b859-652a04595c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0400484f-4621-4b51-b859-652a04595c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fb193c-2577-461d-b330-0f8eb07fa808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fb193c-2577-461d-b330-0f8eb07fa808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1621aab2-e3ee-49e5-838d-3d3dd199d0c9', 'volume_name': 'volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef18252-9550-43d8-a1e2-c1ee9aa0495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef18252-9550-43d8-a1e2-c1ee9aa0495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3468ca-1aa5-4dc1-a826-b615ffed9fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume 1621aab2-e3ee-49e5-838d-3d3dd199d0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9', 'volume_size': 1} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781509148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1621aab2-e3ee-49e5-838d-3d3dd199d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:30Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Creating volume 1621aab2-e3ee-49e5-838d-3d3dd199d0c9 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:30 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:30 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 1073741824 Jul 05 19:56:30 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:30 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4" returned: 0 in 0.876s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:30 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4 Jul 05 19:56:30 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (87c5e03e-85d8-4244-9375-aefc7aad26f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e38c30a-3c20-4cb0-bac7-6089757d116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e38c30a-3c20-4cb0-bac7-6089757d116c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1942888669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2eea58-7231-41ec-b7ce-b050739ced5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:30Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e8abc1-92a2-4069-801b-d1745c52f4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e8abc1-92a2-4069-801b-d1745c52f4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b9eb57-4b48-4024-8a85-1bed00137dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b9eb57-4b48-4024-8a85-1bed00137dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e2eea58-7231-41ec-b7ce-b050739ced5d', 'volume_name': 'volume-4e2eea58-7231-41ec-b7ce-b050739ced5d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57092151-b24d-4359-bbde-e1d356f287f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57092151-b24d-4359-bbde-e1d356f287f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08b7f99-8f47-48fb-9b16-a1e85d5bb275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:30 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume 4e2eea58-7231-41ec-b7ce-b050739ced5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e2eea58-7231-41ec-b7ce-b050739ced5d', 'volume_size': 1} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (814ecb94-7503-4786-9192-c06c48660cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c43dbe-75b6-4fa4-b997-c1badbcf56e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c43dbe-75b6-4fa4-b997-c1badbcf56e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-378947326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a511130c-398a-4ad3-a7ad-4e6a6102eb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:31Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c072ba1-8f29-4654-b50c-a75603308d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c072ba1-8f29-4654-b50c-a75603308d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801e90a8-732d-4e41-b01a-5fec3fd9dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801e90a8-732d-4e41-b01a-5fec3fd9dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a511130c-398a-4ad3-a7ad-4e6a6102eb4b', 'volume_name': 'volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084ea318-6d37-4608-9ed7-5aca4267aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084ea318-6d37-4608-9ed7-5aca4267aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337114b9-736d-4b66-98d4-4578074dca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume a511130c-398a-4ad3-a7ad-4e6a6102eb4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b', 'volume_size': 1} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:31 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4" returned: 0 in 0.730s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4" released by "delete_volume" :: held 1.661s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Created reservations ['eec89782-0866-4d86-9a64-ff0321035e4d', '6210a6d7-c7e1-47c5-aff9-31d20b504228', 'f942f954-4abc-40e9-a877-83dc3aefc446', '19f977e3-90a5-4bbd-ab9e-3e06e88f7c3a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:31 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 1073741824" returned: 0 in 1.131s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (044e55ed-6fb0-4c40-ae70-bd4091734565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6436466e-56b6-4660-9167-6d92aea75f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6436466e-56b6-4660-9167-6d92aea75f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762772304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81401d19-bcae-4744-af20-ac4523361225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:31Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4364fe-d6e6-41a0-ba59-ad93404edf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4364fe-d6e6-41a0-ba59-ad93404edf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a74d4c-9ad0-46eb-be7a-af183e146722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a74d4c-9ad0-46eb-be7a-af183e146722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81401d19-bcae-4744-af20-ac4523361225', 'volume_name': 'volume-81401d19-bcae-4744-af20-ac4523361225', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46197e1a-ddfc-457d-87bf-f628bec94727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46197e1a-ddfc-457d-87bf-f628bec94727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba86e3c8-b065-488a-9901-57712b7d81ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume 81401d19-bcae-4744-af20-ac4523361225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81401d19-bcae-4744-af20-ac4523361225', 'volume_size': 1} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:31 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 Jul 05 19:56:31 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:31 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:31 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (6344c7b2-b5bd-4624-a3cc-fe46cd3f0753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9ad0c0-09ff-447d-a549-499db23c84fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-1803ce33-5d7c-4b47-a037-ca86ae6d948a-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-1803ce33-5d7c-4b47-a037-ca86ae6d948a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9ad0c0-09ff-447d-a549-499db23c84fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816642983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:32Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcf6ba2-e97a-447e-8ef6-00861c22f52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcf6ba2-e97a-447e-8ef6-00861c22f52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c434c28-c4ac-4ac7-b25e-4682e1e9cfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c434c28-c4ac-4ac7-b25e-4682e1e9cfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5', 'volume_name': 'volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a0afd3-a5d2-4594-9373-bd87b41f095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a0afd3-a5d2-4594-9373-bd87b41f095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36751c44-ba82-463d-9d28-32bfe96a4ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume 0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5', 'volume_size': 1} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-quobyte-1803ce33-5d7c-4b47-a037-ca86ae6d948a" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-1803ce33-5d7c-4b47-a037-ca86ae6d948a" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec62e3-75f2-41eb-8395-34d449c56410]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:32 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a Jul 05 19:56:32 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:32 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9" returned: 0 in 0.700s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.580s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1942888669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2eea58-7231-41ec-b7ce-b050739ced5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:30Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Creating volume 4e2eea58-7231-41ec-b7ce-b050739ced5d {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:32 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3468ca-1aa5-4dc1-a826-b615ffed9fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:32 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d 1073741824 Jul 05 19:56:32 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:32 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb747c4-674b-4d5a-ba2e-16987cf0362c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.743s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:32 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Deleted volume successfully. Jul 05 19:56:32 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 (1621aab2-e3ee-49e5-838d-3d3dd199d0c9): created successfully Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb747c4-674b-4d5a-ba2e-16987cf0362c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (b550213a-708b-4936-bd30-c4127ee28d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:32 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e73c7f83-0307-49a9-a620-6cbda564a378 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created volume successfully. Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4b9dfa7e-6f2a-411b-b73d-71971331a402 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-b7d4ca2c-7ed2-4575-8cdb-cd8a3d3f2fa4-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:32 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a" returned: 0 in 0.822s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:32 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a Jul 05 19:56:32 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:33 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d 1073741824" returned: 0 in 0.858s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:33 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d Jul 05 19:56:33 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:33 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1803ce33-5d7c-4b47-a037-ca86ae6d948a" returned: 0 in 0.669s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-1803ce33-5d7c-4b47-a037-ca86ae6d948a" released by "delete_volume" :: held 1.539s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Created reservations ['809c19ef-c336-4667-9a06-dad92bb3b299', '8781bc62-eb47-4405-96d8-8ea01c4b922a', '68a1ec31-ce05-4a7e-9f88-7b850949d6f0', 'ab27806c-8641-4764-9dcd-a6358b28fb28'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:33 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:33 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:33 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d" returned: 0 in 0.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.730s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-378947326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a511130c-398a-4ad3-a7ad-4e6a6102eb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:31Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Creating volume a511130c-398a-4ad3-a7ad-4e6a6102eb4b {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:33 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:33 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b 1073741824 Jul 05 19:56:33 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08b7f99-8f47-48fb-9b16-a1e85d5bb275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e2eea58-7231-41ec-b7ce-b050739ced5d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8623b95-f4c0-4d77-804c-9b589039747b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:33 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume volume-4e2eea58-7231-41ec-b7ce-b050739ced5d (4e2eea58-7231-41ec-b7ce-b050739ced5d): created successfully Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8623b95-f4c0-4d77-804c-9b589039747b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (87c5e03e-85d8-4244-9375-aefc7aad26f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-57ec1834-4624-4405-a2d6-c68bc081a569 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created volume successfully. Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-efbd1649-6e25-4b06-807e-0c1349fba609-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-efbd1649-6e25-4b06-807e-0c1349fba609-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-quobyte-efbd1649-6e25-4b06-807e-0c1349fba609" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-efbd1649-6e25-4b06-807e-0c1349fba609" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a01984f-dfee-4898-aa9e-12d601c71623]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:34 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609 Jul 05 19:56:34 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:34 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.728s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:34 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Deleted volume successfully. Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2d793859-f5ff-4a5c-bcbe-e7fddd4b64cd tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-1803ce33-5d7c-4b47-a037-ca86ae6d948a-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:34 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b 1073741824" returned: 0 in 0.835s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:34 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b Jul 05 19:56:34 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:34 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609" returned: 0 in 0.837s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:35 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609 Jul 05 19:56:35 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:35 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b" returned: 0 in 0.657s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.844s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762772304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81401d19-bcae-4744-af20-ac4523361225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:31Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Creating volume 81401d19-bcae-4744-af20-ac4523361225 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:35 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337114b9-736d-4b66-98d4-4578074dca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:35 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225 1073741824 Jul 05 19:56:35 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdcddd2-d9c3-45b5-9300-e08858e04f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:35 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b (a511130c-398a-4ad3-a7ad-4e6a6102eb4b): created successfully Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdcddd2-d9c3-45b5-9300-e08858e04f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (814ecb94-7503-4786-9192-c06c48660cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-751051c5-8cb1-4cb2-ac3e-b527e609f590 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created volume successfully. Jul 05 19:56:35 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-efbd1649-6e25-4b06-807e-0c1349fba609" returned: 0 in 0.628s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-efbd1649-6e25-4b06-807e-0c1349fba609" released by "delete_volume" :: held 1.516s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Created reservations ['c1f74962-4903-4ca8-b5f5-89e6f2292ea0', '7a85f466-424b-4be1-9c5f-3df4a1b2d4af', '76e21de0-8850-4996-9f08-909f45585921', '10238e92-fb02-4c92-9d45-82c38fe9806c'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:35 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:35 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-b6431ba8-0463-4296-9dbe-b0cd8255dc0e-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:36 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225 1073741824" returned: 0 in 0.925s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-b6431ba8-0463-4296-9dbe-b0cd8255dc0e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "cinder-quobyte-b6431ba8-0463-4296-9dbe-b0cd8255dc0e" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-b6431ba8-0463-4296-9dbe-b0cd8255dc0e" acquired by "delete_volume" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:36 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225 Jul 05 19:56:36 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4573697a-1290-4b90-9b65-2dcd88d349f1]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:36 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.722s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:36 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e Jul 05 19:56:36 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Deleted volume successfully. Jul 05 19:56:36 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-08cdf5da-27cb-415d-90cb-c6d413ac4171 tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-efbd1649-6e25-4b06-807e-0c1349fba609-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:36 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225" returned: 0 in 0.661s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.123s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816642983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ac9c6f0c60470d83eb059cabc357bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:32Z,use_quota=True,user_id='8abef7f65d094e2697aacbb3849ce6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Creating volume 0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:37 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:37 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 1073741824 Jul 05 19:56:37 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba86e3c8-b065-488a-9901-57712b7d81ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81401d19-bcae-4744-af20-ac4523361225', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519e96f5-2e73-417b-ac43-1a593e764eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:37 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume volume-81401d19-bcae-4744-af20-ac4523361225 (81401d19-bcae-4744-af20-ac4523361225): created successfully Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519e96f5-2e73-417b-ac43-1a593e764eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (044e55ed-6fb0-4c40-ae70-bd4091734565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:37 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fde030b9-d9d8-43cc-b9fc-0e7cfd33a1fc tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created volume successfully. Jul 05 19:56:37 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e" returned: 0 in 0.814s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:37 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e Jul 05 19:56:37 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:37 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b6431ba8-0463-4296-9dbe-b0cd8255dc0e" returned: 0 in 0.663s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:37 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 1073741824" returned: 0 in 0.862s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-quobyte-b6431ba8-0463-4296-9dbe-b0cd8255dc0e" released by "delete_volume" :: held 1.525s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:37 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 Jul 05 19:56:37 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Created reservations ['083e8f64-c2fc-4dd9-9784-a8351a68276f', 'd0d06a36-7872-4b50-b976-3a9cc155f893', 'c2e6a7c1-477b-40f6-b222-fd1d8a255306', '33dd1cb5-b4f9-4028-acb1-347bd5f08e6f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:38 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:38 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:38 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5" returned: 0 in 0.673s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36751c44-ba82-463d-9d28-32bfe96a4ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dd2557-6a52-4ad8-8044-5ad9946014fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:38 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Volume volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 (0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5): created successfully Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dd2557-6a52-4ad8-8044-5ad9946014fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Flow 'volume_create_manager' (6344c7b2-b5bd-4624-a3cc-fe46cd3f0753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:38 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1b9ba266-9fc0-499a-985b-7625b8de4262 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created volume successfully. Jul 05 19:56:38 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.681s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:38 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Deleted volume successfully. Jul 05 19:56:38 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-35da34a5-2267-493a-8d94-06404b13fb5f tempest-CreateVolumesFromImageTest-1518149244 None] Lock "cinder-b6431ba8-0463-4296-9dbe-b0cd8255dc0e-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-quobyte-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:39 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d6f1e6-b4ce-438e-bfe7-04cfd6e4419a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:39 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 Jul 05 19:56:39 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:40 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5" returned: 0 in 0.807s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:40 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5 Jul 05 19:56:40 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:41 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5" returned: 0 in 0.664s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5" released by "delete_volume" :: held 1.518s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created reservations ['cf0e6c22-b415-4141-b242-da3815386880', '5f0b73f1-d058-4d2f-b4f2-4004e9f8d344', 'be750fa4-aded-4a50-92db-6983b880cbcf', '6b0b737f-4978-4e56-929b-98005adf614b'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:41 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:41 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Flow 'volume_create_manager' (4b3a1387-81bd-471f-a680-bb1e259b5265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bdbfdc-26d1-4267-9362-9563c235a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bdbfdc-26d1-4267-9362-9563c235a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1470173515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e27a55-8e28-4451-8a3f-a5cd57d29094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d8d8dfcfa9441390856a2f9c365896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:41Z,use_quota=True,user_id='310fe9e28e5443229ef43541e49c358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7590725c-8f2f-4a10-8520-35af742b444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7590725c-8f2f-4a10-8520-35af742b444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349422c1-9b00-46d4-98ac-38ef04f53906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349422c1-9b00-46d4-98ac-38ef04f53906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e27a55-8e28-4451-8a3f-a5cd57d29094', 'volume_name': 'volume-39e27a55-8e28-4451-8a3f-a5cd57d29094', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c7ca8e-2dd5-4d6a-870d-bc1ef299e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c7ca8e-2dd5-4d6a-870d-bc1ef299e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7007c1f7-911b-4e3f-94f3-f45010d5425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:41 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Volume 39e27a55-8e28-4451-8a3f-a5cd57d29094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e27a55-8e28-4451-8a3f-a5cd57d29094', 'volume_size': 1} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1470173515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e27a55-8e28-4451-8a3f-a5cd57d29094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d8d8dfcfa9441390856a2f9c365896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:41Z,use_quota=True,user_id='310fe9e28e5443229ef43541e49c358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Creating volume 39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:41 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:41 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 1073741824 Jul 05 19:56:41 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-81401d19-bcae-4744-af20-ac4523361225-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-81401d19-bcae-4744-af20-ac4523361225-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-quobyte-81401d19-bcae-4744-af20-ac4523361225" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-81401d19-bcae-4744-af20-ac4523361225" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[31483fd0-fb25-4aef-bea9-49ee4f3f5e3a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:41 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:41 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Deleted volume successfully. Jul 05 19:56:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2dc7fe41-53bb-40dd-9da6-dbaee68ef361 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-0935b6f8-bf07-462b-9c10-fb1bf4b6fdc5-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:41 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225 Jul 05 19:56:41 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:42 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 1073741824" returned: 0 in 0.863s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:42 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 Jul 05 19:56:42 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:42 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225" returned: 0 in 0.773s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:42 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225 Jul 05 19:56:42 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:42 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094" returned: 0 in 0.661s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:56:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7007c1f7-911b-4e3f-94f3-f45010d5425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e27a55-8e28-4451-8a3f-a5cd57d29094', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feff7b92-a56a-4c2b-800d-6fbf9f3495a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:43 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Volume volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 (39e27a55-8e28-4451-8a3f-a5cd57d29094): created successfully Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feff7b92-a56a-4c2b-800d-6fbf9f3495a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Flow 'volume_create_manager' (4b3a1387-81bd-471f-a680-bb1e259b5265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:43 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c20613f6-62af-4d0c-917e-b6c810454bd4 tempest-VolumeDependencyTests-1789078229 None] Created volume successfully. Jul 05 19:56:43 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-81401d19-bcae-4744-af20-ac4523361225" returned: 0 in 0.665s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-81401d19-bcae-4744-af20-ac4523361225" released by "delete_volume" :: held 1.496s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created reservations ['1f734a56-cad7-4f5e-b2d9-8cc2fa40afe6', '7ea73dd9-e0c8-4bae-8907-e797eb4d2ac6', 'ca68a02a-a508-4b6f-be5a-dcf9040a4fd3', 'e49a1ee3-9688-4182-b9cd-2bdaf24c6012'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:43 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:43 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Creating offline snapshot ae7c2716-7ddc-4965-b9bd-03cc920360d8 of volume 39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73f4b1-bbf2-427b-a54c-dafbcf906a4c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:43 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 Jul 05 19:56:43 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-a511130c-398a-4ad3-a7ad-4e6a6102eb4b-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-a511130c-398a-4ad3-a7ad-4e6a6102eb4b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-quobyte-a511130c-398a-4ad3-a7ad-4e6a6102eb4b" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-a511130c-398a-4ad3-a7ad-4e6a6102eb4b" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[37545e91-797c-4a70-8c4b-8262b0d69885]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:44 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Deleted volume successfully. Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f7706160-8db0-4556-bd66-849d9a513e35 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-81401d19-bcae-4744-af20-ac4523361225-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:44 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b Jul 05 19:56:44 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:44 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094" returned: 0 in 0.797s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:44 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 1G Jul 05 19:56:44 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:44 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b" returned: 0 in 0.789s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:44 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b Jul 05 19:56:44 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:45 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 1G" returned: 0 in 0.791s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:45 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 Jul 05 19:56:45 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:45 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-a511130c-398a-4ad3-a7ad-4e6a6102eb4b" returned: 0 in 0.667s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-a511130c-398a-4ad3-a7ad-4e6a6102eb4b" released by "delete_volume" :: held 1.505s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created reservations ['2f7af17e-72db-48a5-96dd-d500d7e09153', '600b148e-c2cf-4f07-a926-abfcb50c478f', '91fe04f5-601b-4afb-ba84-22b0675716cd', '5f391b24-9d30-4558-96c1-68b2cf084e69'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:45 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:45 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:45 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8" returned: 0 in 0.679s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:45 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 is being set with open permissions: ugo+rw Jul 05 19:56:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:45 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 Jul 05 19:56:45 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-4e2eea58-7231-41ec-b7ce-b050739ced5d-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-4e2eea58-7231-41ec-b7ce-b050739ced5d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-quobyte-4e2eea58-7231-41ec-b7ce-b050739ced5d" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-4e2eea58-7231-41ec-b7ce-b050739ced5d" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f218745a-0d0c-4d8a-9bec-fb90ebbb4e36]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:46 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.690s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Deleted volume successfully. Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8d3c848f-3a75-4437-957d-22f02a14f8c5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-a511130c-398a-4ad3-a7ad-4e6a6102eb4b-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:46 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d Jul 05 19:56:46 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:46 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8" returned: 0 in 0.674s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:46 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.info Jul 05 19:56:46 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:47 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d" returned: 0 in 0.789s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:47 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d Jul 05 19:56:47 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:47 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.info" returned: 0 in 0.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:47 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.info is being set with open permissions: ugo+rw Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:47 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.info Jul 05 19:56:47 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:47 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4e2eea58-7231-41ec-b7ce-b050739ced5d" returned: 0 in 0.661s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-4e2eea58-7231-41ec-b7ce-b050739ced5d" released by "delete_volume" :: held 1.500s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created reservations ['7948b0a1-ceb8-43d7-9a13-b7a03c528ccc', '472f2c71-6ac1-4e57-a137-540002817791', '27c88afd-7bd9-4eb4-ba4f-87598b6ecfcf', '3fbfd6a4-b067-4c23-b4b4-efe6b66c2795'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:47 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:47 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:47 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.info" returned: 0 in 0.643s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.365s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-705bdc6b-463d-4056-91a0-3fe15b1e1853 tempest-VolumeDependencyTests-1789078229 None] Create snapshot completed successfully Jul 05 19:56:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-1621aab2-e3ee-49e5-838d-3d3dd199d0c9-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-1621aab2-e3ee-49e5-838d-3d3dd199d0c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-quobyte-1621aab2-e3ee-49e5-838d-3d3dd199d0c9" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-1621aab2-e3ee-49e5-838d-3d3dd199d0c9" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:48 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c21215-36a8-4c06-bedc-adb910d8811f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:48 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.688s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:48 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Deleted volume successfully. Jul 05 19:56:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06858d14-fd28-424b-894a-6d53f9e1f4d4 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-4e2eea58-7231-41ec-b7ce-b050739ced5d-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:48 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 Jul 05 19:56:48 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:49 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9" returned: 0 in 0.786s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:56:49 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9 Jul 05 19:56:49 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Flow 'volume_create_manager' (ef39097b-aa42-4323-8c07-5f35044d8f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f6d8df-29d3-4fb3-b3b4-9ac6da9a2b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f6d8df-29d3-4fb3-b3b4-9ac6da9a2b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1481315315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c77249-7906-46e1-a015-8bf6fb297c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d8d8dfcfa9441390856a2f9c365896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ae7c2716-7ddc-4965-b9bd-03cc920360d8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:56:49Z,use_quota=True,user_id='310fe9e28e5443229ef43541e49c358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26a80d7-e424-462a-9e6a-4d2b5144c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26a80d7-e424-462a-9e6a-4d2b5144c325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbe5987-07d6-4764-ae4f-4e9528dcdeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbe5987-07d6-4764-ae4f-4e9528dcdeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '96c77249-7906-46e1-a015-8bf6fb297c27', 'volume_name': 'volume-96c77249-7906-46e1-a015-8bf6fb297c27', 'volume_size': 1, 'snapshot_id': 'ae7c2716-7ddc-4965-b9bd-03cc920360d8'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6af754a-57ce-453a-b194-c24df880ab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6af754a-57ce-453a-b194-c24df880ab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730eba99-56c4-47ea-9716-a8f2bbfd69f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:49 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Volume 96c77249-7906-46e1-a015-8bf6fb297c27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-96c77249-7906-46e1-a015-8bf6fb297c27', 'volume_size': 1, 'snapshot_id': 'ae7c2716-7ddc-4965-b9bd-03cc920360d8'} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "cinder-quobyte-ae7c2716-7ddc-4965-b9bd-03cc920360d8-96c77249-7906-46e1-a015-8bf6fb297c27" by "_create_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-ae7c2716-7ddc-4965-b9bd-03cc920360d8-96c77249-7906-46e1-a015-8bf6fb297c27" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Creating volume 96c77249-7906-46e1-a015-8bf6fb297c27 from snapshot ae7c2716-7ddc-4965-b9bd-03cc920360d8 {{(pid=86389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "cinder-quobyte-96c77249-7906-46e1-a015-8bf6fb297c27" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-96c77249-7906-46e1-a015-8bf6fb297c27" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] snapshot: ae7c2716-7ddc-4965-b9bd-03cc920360d8, volume: 96c77249-7906-46e1-a015-8bf6fb297c27, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c62775b-bd2b-4d76-8215-7addcae361b1]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:49 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 Jul 05 19:56:49 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:50 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1621aab2-e3ee-49e5-838d-3d3dd199d0c9" returned: 0 in 0.701s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-1621aab2-e3ee-49e5-838d-3d3dd199d0c9" released by "delete_volume" :: held 1.529s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created reservations ['4cf4efc6-8988-4ba9-8cf2-fad196c3f6b3', 'c7cd141b-d1bb-4ae5-a2fd-9118de8e7dc5', '247bc305-f8f6-482c-8dfc-1d6331584689', '49f3b3dd-8979-4eb8-b61e-a622b402bb5b'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:50 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:50 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:50 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8" returned: 0 in 0.767s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e27a55-8e28-4451-8a3f-a5cd57d29094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[70783ebb-b8d4-4df6-b6c7-4466ed469e5b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:50 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 Jul 05 19:56:50 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "cinder-quobyte-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2fb62b-0231-4698-924f-cf7c7e7d1a71]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:50 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.681s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:50 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Deleted volume successfully. Jul 05 19:56:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-237b5de4-f8bf-4ff9-81af-2e72fb5b6fb5 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-1621aab2-e3ee-49e5-838d-3d3dd199d0c9-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:50 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 Jul 05 19:56:50 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:51 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094" returned: 0 in 0.826s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:51 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:56:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:51 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 Jul 05 19:56:51 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:51 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7" returned: 0 in 0.760s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:51 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7 Jul 05 19:56:51 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:52 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7" returned: 0 in 0.883s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-quobyte-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7" released by "delete_volume" :: held 1.712s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:52 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Created reservations ['da1523d7-f7db-45dc-bc4a-2f56afd8566d', '56a55eb1-0af0-42e8-afb7-8351aa0f8f9c', '5495364d-2728-4532-9fdb-6a3a1b1d0c60', '4737ecf1-5673-43f5-a947-a49e68d3f4f0'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:56:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:56:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:56:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:56:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:56:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:52 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:56:52 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:53 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.123s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:53 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:56:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Deleted volume successfully. Jul 05 19:56:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-445a5bed-30fe-49da-a2a4-6543348b3066 tempest-CreateVolumesFromSourceVolumeTest-2131770931 None] Lock "cinder-c4449b00-6ccc-46fa-9b8d-7ea76ac1d4b7-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:56 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27" returned: 0 in 5.364s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:56 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[429d66c6-9ab3-48b8-b49c-31bda5951e95]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:56 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 Jul 05 19:56:56 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:57 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094" returned: 0 in 0.929s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:57 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:56:57 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Converted 1024.00 MB image at 190.86 MB/s Jul 05 19:56:57 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 is being set with open permissions: ugo+rw Jul 05 19:56:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:57 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 Jul 05 19:56:57 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:56:58 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jul 05 19:56:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27" returned: 0 in 0.675s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:56:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-96c77249-7906-46e1-a015-8bf6fb297c27" released by "_copy_volume_from_snapshot" :: held 8.670s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-ae7c2716-7ddc-4965-b9bd-03cc920360d8-96c77249-7906-46e1-a015-8bf6fb297c27" released by "_create_volume_from_snapshot" :: held 8.707s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:56:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.723s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:56:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730eba99-56c4-47ea-9716-a8f2bbfd69f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c77249-7906-46e1-a015-8bf6fb297c27', 'volume_size': 1, 'snapshot_id': 'ae7c2716-7ddc-4965-b9bd-03cc920360d8'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95342a0-9b8f-4fb6-879d-b7e412c6fc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:56:58 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Volume volume-96c77249-7906-46e1-a015-8bf6fb297c27 (96c77249-7906-46e1-a015-8bf6fb297c27): created successfully Jul 05 19:56:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95342a0-9b8f-4fb6-879d-b7e412c6fc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:56:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Flow 'volume_create_manager' (ef39097b-aa42-4323-8c07-5f35044d8f4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:56:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-06716764-be48-46c1-b519-d4f7ba77b036 tempest-VolumeDependencyTests-1789078229 None] Created volume successfully. Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "cinder-ae7c2716-7ddc-4965-b9bd-03cc920360d8-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-ae7c2716-7ddc-4965-b9bd-03cc920360d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "cinder-quobyte-39e27a55-8e28-4451-8a3f-a5cd57d29094" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-39e27a55-8e28-4451-8a3f-a5cd57d29094" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "cinder-quobyte-ae7c2716-7ddc-4965-b9bd-03cc920360d8" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-ae7c2716-7ddc-4965-b9bd-03cc920360d8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Deleting offline snapshot ae7c2716-7ddc-4965-b9bd-03cc920360d8 of volume 39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] snapshot_file for this snap is: volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db9dec9-7693-42c9-a3f1-cda2a9164cde]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:56:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:56:59 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 Jul 05 19:56:59 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:00 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8" returned: 0 in 0.811s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e27a55-8e28-4451-8a3f-a5cd57d29094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:57:00 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0b029f-4c1c-41e9-af87-1ee870cb4d8d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:00 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 Jul 05 19:57:00 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:00 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094" returned: 0 in 0.792s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:00 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 Jul 05 19:57:00 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:01 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8" returned: 0 in 0.704s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:01 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8 Jul 05 19:57:01 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:02 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094.ae7c2716-7ddc-4965-b9bd-03cc920360d8" returned: 0 in 0.645s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-ae7c2716-7ddc-4965-b9bd-03cc920360d8" released by "_delete_snapshot" :: held 3.065s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-39e27a55-8e28-4451-8a3f-a5cd57d29094" released by "delete_snapshot" :: held 3.101s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:02 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Created reservations ['a1d1ad2a-3b6e-4d11-97e5-52cfdbc962ae', '96f94b65-f82d-4d94-81a6-3fe1ea69cfc3', 'aaf4bc2d-68cf-401a-8f17-a097924c9c7d', '13ef2bca-4b5e-462a-b4bf-0acaad33bdd6'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:57:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Delete snapshot completed successfully. Jul 05 19:57:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f59230c7-ebdd-4f1b-9717-d1ec3e867a28 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-ae7c2716-7ddc-4965-b9bd-03cc920360d8-delete_snapshot" released by "delete_snapshot" :: held 3.238s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "cinder-39e27a55-8e28-4451-8a3f-a5cd57d29094-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-39e27a55-8e28-4451-8a3f-a5cd57d29094-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "cinder-quobyte-39e27a55-8e28-4451-8a3f-a5cd57d29094" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-39e27a55-8e28-4451-8a3f-a5cd57d29094" acquired by "delete_volume" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:03 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dde70d-769d-4b3c-93e3-2a84200364ac]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:03 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 Jul 05 19:57:03 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:04 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094" returned: 0 in 0.768s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:04 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094 Jul 05 19:57:04 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:04 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-39e27a55-8e28-4451-8a3f-a5cd57d29094" returned: 0 in 0.630s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-39e27a55-8e28-4451-8a3f-a5cd57d29094" released by "delete_volume" :: held 1.454s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Created reservations ['7a471fd8-29f9-42c5-b804-073a007db9d8', 'b55716b2-d7fc-4dbb-b037-1f8f0a89bbd9', 'd4e917f9-1eac-4c44-9702-e4a3e6c2cd0a', '0fc06a22-63bb-4d6e-a204-740615f8ec5a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:05 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:57:05 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "cinder-96c77249-7906-46e1-a015-8bf6fb297c27-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-96c77249-7906-46e1-a015-8bf6fb297c27-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "cinder-quobyte-96c77249-7906-46e1-a015-8bf6fb297c27" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-96c77249-7906-46e1-a015-8bf6fb297c27" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:05 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.674s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:57:05 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Deleted volume successfully. Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3016082-aae0-4ec2-b2d6-6244206ed052]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5ace1028-43db-4165-a288-08e0da558bd7 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-39e27a55-8e28-4451-8a3f-a5cd57d29094-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:05 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 Jul 05 19:57:05 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:06 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27" returned: 0 in 0.749s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:06 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27 Jul 05 19:57:06 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:07 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-96c77249-7906-46e1-a015-8bf6fb297c27" returned: 0 in 0.646s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-quobyte-96c77249-7906-46e1-a015-8bf6fb297c27" released by "delete_volume" :: held 1.444s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Created reservations ['991a75cb-55b0-4652-ac41-30796b07372d', 'da72f4d5-5eaf-409a-9cbe-d4a7d8a48d7f', 'df7a5b40-a695-4de7-a263-53d5dbfe83a0', '34ca1aa2-46b9-467a-9eaa-9c2b7406c330'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:07 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:57:07 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:07 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.653s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:57:07 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Deleted volume successfully. Jul 05 19:57:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7a9460c8-fb19-45db-86e8-fdca6b7e4ba9 tempest-VolumeDependencyTests-1789078229 None] Lock "cinder-96c77249-7906-46e1-a015-8bf6fb297c27-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Flow 'volume_create_manager' (75731cc1-5ce6-4640-8e36-0b0efd7cd7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f639666e-ca7a-4822-89c4-b0ac1b1b0e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f639666e-ca7a-4822-89c4-b0ac1b1b0e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26eeede9-c73a-4520-b6a9-43d7e3b391b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b85b5389da46239aa294f170ce99c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:13Z,use_quota=True,user_id='8ed82339c4714f68af82ca6eebf36b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1091c1ac-9592-4a1a-bb54-697d64bf7ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1091c1ac-9592-4a1a-bb54-697d64bf7ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2428cfd6-01f4-4229-b6f4-89c61d2c9d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.image.glance [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Creating Keystone auth plugin from conf {{(pid=86389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2428cfd6-01f4-4229-b6f4-89c61d2c9d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26eeede9-c73a-4520-b6a9-43d7e3b391b2', 'volume_name': 'volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2', 'volume_size': 1, 'image_id': '5ad70d93-096e-4446-b994-a9492f55d363', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ad70d93-096e-4446-b994-a9492f55d363', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b2f9a040deb1fa70d5ec8276377632f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd1b85b5389da46239aa294f170ce99c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ff030e0b4de67926a7fcc5bf5dad828607f260b0a76f58e9103ba9bdeae8ae7f94c0a313d3d382d67d8489fde6f37d9b6810f83646c382858c2b9b36e0f09c4', 'id': '5ad70d93-096e-4446-b994-a9492f55d363', 'created_at': datetime.datetime(2026, 7, 5, 17, 57, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 57, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ad70d93-096e-4446-b994-a9492f55d363/file', 'properties': {}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379a92f7-a6cf-466f-9403-e918d8ec9648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379a92f7-a6cf-466f-9403-e918d8ec9648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ea328a-2af7-45b1-b4f1-78794359007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:13 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Volume 26eeede9-c73a-4520-b6a9-43d7e3b391b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2', 'volume_size': 1, 'image_id': '5ad70d93-096e-4446-b994-a9492f55d363', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ad70d93-096e-4446-b994-a9492f55d363', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b2f9a040deb1fa70d5ec8276377632f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd1b85b5389da46239aa294f170ce99c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ff030e0b4de67926a7fcc5bf5dad828607f260b0a76f58e9103ba9bdeae8ae7f94c0a313d3d382d67d8489fde6f37d9b6810f83646c382858c2b9b36e0f09c4', 'id': '5ad70d93-096e-4446-b994-a9492f55d363', 'created_at': datetime.datetime(2026, 7, 5, 17, 57, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 57, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ad70d93-096e-4446-b994-a9492f55d363/file', 'properties': {}}, 'image_service': } Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Trying to clone 26eeede9-c73a-4520-b6a9-43d7e3b391b2 from image 5ad70d93-096e-4446-b994-a9492f55d363 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ad70d93-096e-4446-b994-a9492f55d363', 'metadata': {}}]). {{(pid=86389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 19:57:13 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Image download 0.00 MB at 0.00 MB/s Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[804000a3-5109-4b19-8d83-b846c2abad02]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:13 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD Jul 05 19:57:13 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:14 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:14 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD Jul 05 19:57:14 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:15 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD" returned: 1 in 0.716s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:57:15 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Temporary image 5ad70d93-096e-4446-b994-a9492f55d363 is fetched for user 8ed82339c4714f68af82ca6eebf36b01. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 19:57:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e932f04-f987-473c-9b4f-d74599225e2b]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:15 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD Jul 05 19:57:15 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:16 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:16 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD Jul 05 19:57:16 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:16 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:57:16 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:16 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD" returned: 1 in 0.731s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26eeede9-c73a-4520-b6a9-43d7e3b391b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b85b5389da46239aa294f170ce99c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:13Z,use_quota=True,user_id='8ed82339c4714f68af82ca6eebf36b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Creating volume 26eeede9-c73a-4520-b6a9-43d7e3b391b2 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:16 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:16 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 1073741824 Jul 05 19:57:16 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:16 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.642s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:57:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:57:17 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 1073741824" returned: 0 in 0.807s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:17 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 Jul 05 19:57:17 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:18 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2" returned: 0 in 0.630s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:18 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Attempting download of 5ad70d93-096e-4446-b994-a9492f55d363 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ad70d93-096e-4446-b994-a9492f55d363', 'metadata': {}}])) to volume 26eeede9-c73a-4520-b6a9-43d7e3b391b2. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 19:57:18 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f356db-9613-4f9d-b6d1-977d96cfa137]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ad70d93-096e-4446-b994-a9492f55d363_lbu1l_nk {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:18 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ad70d93-096e-4446-b994-a9492f55d363_lbu1l_nk Jul 05 19:57:18 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:19 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ad70d93-096e-4446-b994-a9492f55d363_lbu1l_nk" returned: 0 in 0.724s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad70d93-096e-4446-b994-a9492f55d363_lbu1l_nk {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:19 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad70d93-096e-4446-b994-a9492f55d363_lbu1l_nk Jul 05 19:57:19 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:19 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad70d93-096e-4446-b994-a9492f55d363_lbu1l_nk" returned: 1 in 0.722s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad70d93-096e-4446-b994-a9492f55d363_lbu1l_nk' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:57:19 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d476eb50-29ba-4692-9e13-f0e943658ee4]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:19 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD Jul 05 19:57:19 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:20 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:20 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD Jul 05 19:57:20 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:21 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD" returned: 1 in 0.717s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:57:21 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] 5ad70d93-096e-4446-b994-a9492f55d363 was raw, converting to raw {{(pid=86389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 19:57:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:21 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 Jul 05 19:57:21 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:21 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2" returned: 0 in 0.715s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:21 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ad70d93-096e-4446-b994-a9492f55d363_d596yh6tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:57:21 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 19:57:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:21 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 1G Jul 05 19:57:21 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:22 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 1G" returned: 0 in 0.673s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c66525d-ec45-460a-b343-5dd5931244e3]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:22 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 Jul 05 19:57:22 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:23 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2" returned: 0 in 0.754s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:23 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 Jul 05 19:57:23 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:24 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2" returned: 1 in 0.726s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Downloaded image 5ad70d93-096e-4446-b994-a9492f55d363 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ad70d93-096e-4446-b994-a9492f55d363', 'metadata': {}}])) to volume 26eeede9-c73a-4520-b6a9-43d7e3b391b2 successfully. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Temporary image 5ad70d93-096e-4446-b994-a9492f55d363 for user 8ed82339c4714f68af82ca6eebf36b01 is deleted. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Marking volume 26eeede9-c73a-4520-b6a9-43d7e3b391b2 as bootable. {{(pid=86389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Copying metadata from image 5ad70d93-096e-4446-b994-a9492f55d363 to 26eeede9-c73a-4520-b6a9-43d7e3b391b2. {{(pid=86389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Creating volume glance metadata for volume 26eeede9-c73a-4520-b6a9-43d7e3b391b2 backed by image 5ad70d93-096e-4446-b994-a9492f55d363 with: {'image_id': '5ad70d93-096e-4446-b994-a9492f55d363', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b2f9a040deb1fa70d5ec8276377632f9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ea328a-2af7-45b1-b4f1-78794359007a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2', 'volume_size': 1, 'image_id': '5ad70d93-096e-4446-b994-a9492f55d363', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ad70d93-096e-4446-b994-a9492f55d363', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b2f9a040deb1fa70d5ec8276377632f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd1b85b5389da46239aa294f170ce99c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ff030e0b4de67926a7fcc5bf5dad828607f260b0a76f58e9103ba9bdeae8ae7f94c0a313d3d382d67d8489fde6f37d9b6810f83646c382858c2b9b36e0f09c4', 'id': '5ad70d93-096e-4446-b994-a9492f55d363', 'created_at': datetime.datetime(2026, 7, 5, 17, 57, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 57, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ad70d93-096e-4446-b994-a9492f55d363/file', 'properties': {}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1934345-655b-4e0f-875f-1748a719aca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:24 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Volume volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 (26eeede9-c73a-4520-b6a9-43d7e3b391b2): created successfully Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1934345-655b-4e0f-875f-1748a719aca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:24 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Flow 'volume_create_manager' (75731cc1-5ce6-4640-8e36-0b0efd7cd7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2fa87f3b-42d8-493b-a1fd-8290a4a3802e tempest-VolumeImageDependencyTests-1550556673 None] Created volume successfully. Jul 05 19:57:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Acquiring lock "cinder-26eeede9-c73a-4520-b6a9-43d7e3b391b2-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Lock "cinder-26eeede9-c73a-4520-b6a9-43d7e3b391b2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Acquiring lock "cinder-quobyte-26eeede9-c73a-4520-b6a9-43d7e3b391b2" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Lock "cinder-quobyte-26eeede9-c73a-4520-b6a9-43d7e3b391b2" acquired by "delete_volume" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:25 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5d57e2-fe82-4344-9763-62cc29d6d648]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:25 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 Jul 05 19:57:25 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:25 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2" returned: 0 in 0.726s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:25 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 Jul 05 19:57:25 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:26 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2" returned: 1 in 0.720s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:57:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:26 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2 Jul 05 19:57:26 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:27 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-26eeede9-c73a-4520-b6a9-43d7e3b391b2" returned: 0 in 0.622s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Lock "cinder-quobyte-26eeede9-c73a-4520-b6a9-43d7e3b391b2" released by "delete_volume" :: held 2.130s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Created reservations ['336e4696-6591-401c-988e-e98da0110a13', '85b1189b-cc2d-4da9-8394-ca6f7bee8468', 'f4174458-14ef-4048-85d4-8041fc3e90b6', '089eea4f-2660-4687-b9ec-7c96e32c2705'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:27 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:57:27 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:27 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.618s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:57:27 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Deleted volume successfully. Jul 05 19:57:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0aaa5314-a36f-446a-81b2-7c743eb55d37 tempest-VolumeImageDependencyTests-1550556673 None] Lock "cinder-26eeede9-c73a-4520-b6a9-43d7e3b391b2-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:37 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=98,cinder:UPDATE=139,cinder:INSERT=30,cinder:DELETE=11 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:57:37 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=134,cinder:DELETE=13,cinder:SELECT=95,cinder:INSERT=43 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (c5e6cb71-8b78-414b-83c7-1887d8adf90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bff726-9265-4b72-9bd2-050b78add39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bff726-9265-4b72-9bd2-050b78add39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1657252816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24ac3f7-e863-4a3e-b944-0d94a0056f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:44Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5705f6-b1dd-416e-854e-ec0c45f7186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5705f6-b1dd-416e-854e-ec0c45f7186e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24482714-75ed-45b6-953c-04f3652afc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24482714-75ed-45b6-953c-04f3652afc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e24ac3f7-e863-4a3e-b944-0d94a0056f33', 'volume_name': 'volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48717bc6-c0df-4493-85f1-721ea016b136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48717bc6-c0df-4493-85f1-721ea016b136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a78d96e-581c-4f0c-a788-5b2c4f6ab071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume e24ac3f7-e863-4a3e-b944-0d94a0056f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33', 'volume_size': 1} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1657252816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24ac3f7-e863-4a3e-b944-0d94a0056f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:44Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Creating volume e24ac3f7-e863-4a3e-b944-0d94a0056f33 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:44 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:44 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 1073741824 Jul 05 19:57:44 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (c7b3a058-b28e-4f70-bc7d-422d65cdd41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efcf79a5-57ef-4870-ad91-f08f949d874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (f0a35ee5-66b9-47be-b50a-21ddb90f62ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098b2a51-b9fd-4cd6-b52d-677ff3f5ef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efcf79a5-57ef-4870-ad91-f08f949d874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985901415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f135767-18ad-406c-ab0d-363ad8be03c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:44Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037aec25-8080-49e8-9f95-26848c1b1a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037aec25-8080-49e8-9f95-26848c1b1a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794e5dd8-e87f-4952-a1e8-7f7cbb04c16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794e5dd8-e87f-4952-a1e8-7f7cbb04c16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f135767-18ad-406c-ab0d-363ad8be03c5', 'volume_name': 'volume-9f135767-18ad-406c-ab0d-363ad8be03c5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a5cc67-30d0-471e-8d81-e2f4a824726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a5cc67-30d0-471e-8d81-e2f4a824726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acca711a-d85c-49a8-b6f2-f9ac38c7d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Volume 9f135767-18ad-406c-ab0d-363ad8be03c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f135767-18ad-406c-ab0d-363ad8be03c5', 'volume_size': 1} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098b2a51-b9fd-4cd6-b52d-677ff3f5ef33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2021859250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e83e823-490d-4824-afe4-877755642a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:45Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3b576a-cdae-4875-a014-e631a4e5a07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3b576a-cdae-4875-a014-e631a4e5a07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d158811e-c415-40f8-be9a-45079af8684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d158811e-c415-40f8-be9a-45079af8684d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e83e823-490d-4824-afe4-877755642a09', 'volume_name': 'volume-1e83e823-490d-4824-afe4-877755642a09', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81903dda-dfde-4108-8467-f32d2c16ab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81903dda-dfde-4108-8467-f32d2c16ab0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae217fb-08f0-4131-90d2-b06a745a7c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:44 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Volume 1e83e823-490d-4824-afe4-877755642a09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e83e823-490d-4824-afe4-877755642a09', 'volume_size': 1} Jul 05 19:57:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Flow 'volume_create_manager' (274c6788-74ae-4d50-b36f-ae67d61d1831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa1e1b2-fec0-4729-8b8c-652c44db9f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa1e1b2-fec0-4729-8b8c-652c44db9f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208fc041-dd76-44f2-8a97-2879f66c9cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae687f74c9049ec8c0ae4498ae7c25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:45Z,use_quota=True,user_id='7516e0317adc448a84f5b555ff792004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f43053-2ba8-4c9c-84d4-d82e81ae756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f43053-2ba8-4c9c-84d4-d82e81ae756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4d2602-2efa-4156-8f5a-1ec681162688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4d2602-2efa-4156-8f5a-1ec681162688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208fc041-dd76-44f2-8a97-2879f66c9cb8', 'volume_name': 'volume-208fc041-dd76-44f2-8a97-2879f66c9cb8', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cd9617-47c7-4c92-bbe4-81dcef1b3e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cd9617-47c7-4c92-bbe4-81dcef1b3e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ada2927-7a91-45bc-9eea-7647b8daf339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Volume 208fc041-dd76-44f2-8a97-2879f66c9cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208fc041-dd76-44f2-8a97-2879f66c9cb8', 'volume_size': 1} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (29785fd9-162d-427d-97f3-4811dde16d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed529274-62fc-48f9-9cfb-7aac657bc27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed529274-62fc-48f9-9cfb-7aac657bc27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-886938940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35166313-d0ab-477c-adc7-c7dfde0c7945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:45Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1fa966-3ced-42d4-bc80-b9d092238e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1fa966-3ced-42d4-bc80-b9d092238e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2a8da6-8a57-4c4e-9ad3-a40daa697f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2a8da6-8a57-4c4e-9ad3-a40daa697f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35166313-d0ab-477c-adc7-c7dfde0c7945', 'volume_name': 'volume-35166313-d0ab-477c-adc7-c7dfde0c7945', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e967023-bf2e-4f51-91c1-60a62e8dec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e967023-bf2e-4f51-91c1-60a62e8dec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac11e12-c115-45a5-9652-f1f3f37a0e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Volume 35166313-d0ab-477c-adc7-c7dfde0c7945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35166313-d0ab-477c-adc7-c7dfde0c7945', 'volume_size': 1} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (a0ba5493-e06c-42bb-bfe1-e34b0f1a804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0a9a9f-b416-4ac0-84e0-67a3fd9d3ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0a9a9f-b416-4ac0-84e0-67a3fd9d3ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690479562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757b8f8b-a20b-4f34-8c91-be1705545beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:45Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a815fb-4e15-428f-a1ab-48c628a06ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a815fb-4e15-428f-a1ab-48c628a06ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158fa261-2415-4eae-99a1-56decc64fd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158fa261-2415-4eae-99a1-56decc64fd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757b8f8b-a20b-4f34-8c91-be1705545beb', 'volume_name': 'volume-757b8f8b-a20b-4f34-8c91-be1705545beb', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89757352-39c0-4a59-bb0f-e269cc269c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89757352-39c0-4a59-bb0f-e269cc269c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a128fbd-c6a6-494a-84f6-08c65442c64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Volume 757b8f8b-a20b-4f34-8c91-be1705545beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757b8f8b-a20b-4f34-8c91-be1705545beb', 'volume_size': 1} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (ffce251c-0e3b-4f51-80f7-52363c285294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad86efe-7297-4385-af58-d97335c2e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad86efe-7297-4385-af58-d97335c2e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032609619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d42b5e-dd24-426e-b652-b86a472556a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:46Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c6f700-de9e-4867-a789-71885dc5cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c6f700-de9e-4867-a789-71885dc5cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea509c3-6e20-48d1-8475-aecdc183e017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea509c3-6e20-48d1-8475-aecdc183e017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d42b5e-dd24-426e-b652-b86a472556a0', 'volume_name': 'volume-62d42b5e-dd24-426e-b652-b86a472556a0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08176f88-efe9-4d16-9832-75dc0f8c28a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08176f88-efe9-4d16-9832-75dc0f8c28a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09e0983-9ad6-40b8-ac0b-6280b1d3ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:45 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Volume 62d42b5e-dd24-426e-b652-b86a472556a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d42b5e-dd24-426e-b652-b86a472556a0', 'volume_size': 1} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 1073741824" returned: 0 in 1.301s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:45 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 Jul 05 19:57:45 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:46 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33" returned: 0 in 0.656s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.762s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985901415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f135767-18ad-406c-ab0d-363ad8be03c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:44Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Creating volume 9f135767-18ad-406c-ab0d-363ad8be03c5 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:46 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:46 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5 1073741824 Jul 05 19:57:46 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a78d96e-581c-4f0c-a788-5b2c4f6ab071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41aba11-038a-45ca-bec0-fd110ca7eb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:46 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 (e24ac3f7-e863-4a3e-b944-0d94a0056f33): created successfully Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41aba11-038a-45ca-bec0-fd110ca7eb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (c5e6cb71-8b78-414b-83c7-1887d8adf90f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ec1214ae-7db5-4e25-af50-4da972bf7845 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created volume successfully. Jul 05 19:57:47 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5 1073741824" returned: 0 in 0.897s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:47 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5 Jul 05 19:57:47 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (88ff55c9-cf37-4b03-8280-60b84244f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6669e2-d2e7-4b89-83bd-b4af54f298ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6669e2-d2e7-4b89-83bd-b4af54f298ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1600128735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:48Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5146c4b-50ff-4eb7-8768-052961726d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5146c4b-50ff-4eb7-8768-052961726d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24b4f80-06ee-427d-8095-8c86330bbab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24b4f80-06ee-427d-8095-8c86330bbab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d', 'volume_name': 'volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99127ebd-6003-47c1-aeea-79f390045d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99127ebd-6003-47c1-aeea-79f390045d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ed2ad6-2101-4e1c-8373-7241dd15a33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:47 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d', 'volume_size': 1} Jul 05 19:57:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (b70f29b5-f064-4d23-85f9-a309a4164e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d3159c-aeb9-4182-ae3d-e4149666165a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5" returned: 0 in 0.790s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.436s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2021859250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e83e823-490d-4824-afe4-877755642a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:45Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Creating volume 1e83e823-490d-4824-afe4-877755642a09 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:48 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d3159c-aeb9-4182-ae3d-e4149666165a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141071700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115dcce3-c812-411a-99a9-19140d2c7aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:48Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cdd397-205d-40b5-a301-d3364c5772d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cdd397-205d-40b5-a301-d3364c5772d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5cb8e7-e1c0-4484-8281-2f08d5a36ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09 1073741824 Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5cb8e7-e1c0-4484-8281-2f08d5a36ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '115dcce3-c812-411a-99a9-19140d2c7aa5', 'volume_name': 'volume-115dcce3-c812-411a-99a9-19140d2c7aa5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6af701d-1e64-4122-9edc-9e906ef8cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6af701d-1e64-4122-9edc-9e906ef8cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d924f3-f8c8-4928-b6e2-dc0ea18f6412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume 115dcce3-c812-411a-99a9-19140d2c7aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-115dcce3-c812-411a-99a9-19140d2c7aa5', 'volume_size': 1} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acca711a-d85c-49a8-b6f2-f9ac38c7d438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f135767-18ad-406c-ab0d-363ad8be03c5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3050ac15-a429-4e0c-9c65-20958c552d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Volume volume-9f135767-18ad-406c-ab0d-363ad8be03c5 (9f135767-18ad-406c-ab0d-363ad8be03c5): created successfully Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3050ac15-a429-4e0c-9c65-20958c552d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (c7b3a058-b28e-4f70-bc7d-422d65cdd41d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d536897a-1466-4de2-ac63-ff9123edcc8a tempest-CreateVolumesFromImageTest-1559177592 None] Created volume successfully. Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Flow 'volume_create_manager' (01bd9ef7-a04a-4179-940f-9ec80dc9aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7165fe10-9173-4971-94c5-81587cf0421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7165fe10-9173-4971-94c5-81587cf0421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d900db53-99bc-4d54-9ee9-c650df6dadb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053a8bb27a2744eaa9447b9d9e5db05d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:49Z,use_quota=True,user_id='6ef25e2d8ed3403ca4a96c8f15fc29de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b822a10-6eb0-4d18-a68e-24534c3d2c3f),volume_type_id=5b822a10-6eb0-4d18-a68e-24534c3d2c3f)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006a3797-35ce-4b6e-9bc3-1ccaa1746b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006a3797-35ce-4b6e-9bc3-1ccaa1746b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b332f1b0-3624-4f97-ab79-a0bba7fb3373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.image.glance [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Creating Keystone auth plugin from conf {{(pid=86389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (87a5d535-d3f2-4d0c-8877-7a0025a47645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224ba43a-f401-456c-b244-19724549c373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224ba43a-f401-456c-b244-19724549c373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1270245939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd35d42-9d93-4da6-88b0-7dd176468b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:49Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7395c2c6-ed4b-4a00-975d-0b4baa1d61b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7395c2c6-ed4b-4a00-975d-0b4baa1d61b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb486b8-a02a-49f1-beec-3cdf1dcc0fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb486b8-a02a-49f1-beec-3cdf1dcc0fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd35d42-9d93-4da6-88b0-7dd176468b86', 'volume_name': 'volume-abd35d42-9d93-4da6-88b0-7dd176468b86', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745999da-4e55-428e-8c62-e645ba108376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745999da-4e55-428e-8c62-e645ba108376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8e6c24-d2d2-4f11-8341-0069e7a11b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:48 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume abd35d42-9d93-4da6-88b0-7dd176468b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd35d42-9d93-4da6-88b0-7dd176468b86', 'volume_size': 1} Jul 05 19:57:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b332f1b0-3624-4f97-ab79-a0bba7fb3373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd900db53-99bc-4d54-9ee9-c650df6dadb7', 'volume_name': 'volume-d900db53-99bc-4d54-9ee9-c650df6dadb7', 'volume_size': 1, 'image_id': 'ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d3ff4ef7d953697bcf3fbc70ae5d741', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '053a8bb27a2744eaa9447b9d9e5db05d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0e8ac03ee6222c385d5c25647a78326624c6e0aebf83570562438e179080c5aa570560efe00720057606cb40dc20452a63e3830db444a8acb0f686e214db230', 'id': 'ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'created_at': datetime.datetime(2026, 7, 5, 17, 57, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 57, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca9bfc65-5194-4ae3-80c9-4cdb31a36fee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b7a69e-b048-414b-9bfc-10795b01ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b7a69e-b048-414b-9bfc-10795b01ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923d755a-3a3f-4b2a-84c1-36c41232dd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Volume d900db53-99bc-4d54-9ee9-c650df6dadb7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d900db53-99bc-4d54-9ee9-c650df6dadb7', 'volume_size': 1, 'image_id': 'ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d3ff4ef7d953697bcf3fbc70ae5d741', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '053a8bb27a2744eaa9447b9d9e5db05d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0e8ac03ee6222c385d5c25647a78326624c6e0aebf83570562438e179080c5aa570560efe00720057606cb40dc20452a63e3830db444a8acb0f686e214db230', 'id': 'ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'created_at': datetime.datetime(2026, 7, 5, 17, 57, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 57, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca9bfc65-5194-4ae3-80c9-4cdb31a36fee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Trying to clone d900db53-99bc-4d54-9ee9-c650df6dadb7 from image ca9bfc65-5194-4ae3-80c9-4cdb31a36fee at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'metadata': {}}]). {{(pid=86389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 19:57:49 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Image download 0.00 MB at 0.00 MB/s Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae77599-f1f0-4f6d-a7c5-459f46460f20]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (9bff5aa4-5ed8-41f4-8012-519981651f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d03095b-cf7a-4fe9-94b2-a8418e9abc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d03095b-cf7a-4fe9-94b2-a8418e9abc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663601266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46d4a5c-bf1a-472d-a243-764fe456f4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:49Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2747691-2bd6-401b-a22e-d7e5c62a44af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2747691-2bd6-401b-a22e-d7e5c62a44af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68089379-ab05-4a9e-b520-230ce89dce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68089379-ab05-4a9e-b520-230ce89dce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46d4a5c-bf1a-472d-a243-764fe456f4ca', 'volume_name': 'volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0181b358-a6d7-48fc-9d9e-5978d2e5f288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0181b358-a6d7-48fc-9d9e-5978d2e5f288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1c440e-2ca7-42e3-b895-c50006003332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume f46d4a5c-bf1a-472d-a243-764fe456f4ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca', 'volume_size': 1} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:49 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:49 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09 1073741824" returned: 0 in 1.161s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:49 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:49 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09 Jul 05 19:57:49 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (15a9b779-39c6-4add-b97c-7d09d3faf9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bbb70e-8436-4bc4-95ca-d965bd7e9600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bbb70e-8436-4bc4-95ca-d965bd7e9600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-727323814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7e2b6a-10e8-400f-ae2b-45370163311b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:50Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f19e04-d718-4f7a-b2b4-c0b7499bfb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f19e04-d718-4f7a-b2b4-c0b7499bfb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb02961-2647-4336-8a15-55736ca8cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb02961-2647-4336-8a15-55736ca8cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7e2b6a-10e8-400f-ae2b-45370163311b', 'volume_name': 'volume-5c7e2b6a-10e8-400f-ae2b-45370163311b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b021b8e-14bd-4994-b06b-3ebd3e1cbdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b021b8e-14bd-4994-b06b-3ebd3e1cbdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6be07d-dd3d-4daf-a0eb-13f390486041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:49 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume 5c7e2b6a-10e8-400f-ae2b-45370163311b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7e2b6a-10e8-400f-ae2b-45370163311b', 'volume_size': 1} Jul 05 19:57:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:50 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:50 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09" returned: 0 in 0.680s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.018s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208fc041-dd76-44f2-8a97-2879f66c9cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae687f74c9049ec8c0ae4498ae7c25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:45Z,use_quota=True,user_id='7516e0317adc448a84f5b555ff792004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Creating volume 208fc041-dd76-44f2-8a97-2879f66c9cb8 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:50 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:50 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:50 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:50 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 1073741824 Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae217fb-08f0-4131-90d2-b06a745a7c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e83e823-490d-4824-afe4-877755642a09', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:50 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6984ca-dd52-4d2a-82fb-09089b785c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:50 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Volume volume-1e83e823-490d-4824-afe4-877755642a09 (1e83e823-490d-4824-afe4-877755642a09): created successfully Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6984ca-dd52-4d2a-82fb-09089b785c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (f0a35ee5-66b9-47be-b50a-21ddb90f62ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:50 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b9436cfa-ffb8-4d26-8e78-d2f9064e11a8 tempest-CreateVolumesFromImageTest-1559177592 None] Created volume successfully. Jul 05 19:57:50 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD" returned: 1 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Temporary image ca9bfc65-5194-4ae3-80c9-4cdb31a36fee is fetched for user 6ef25e2d8ed3403ca4a96c8f15fc29de. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[206db0f0-9e9a-4579-b70a-9bba1f063f84]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:51 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD Jul 05 19:57:51 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:51 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 1073741824" returned: 0 in 0.828s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:51 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 Jul 05 19:57:51 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:51 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:51 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8" returned: 0 in 0.636s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.473s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-886938940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35166313-d0ab-477c-adc7-c7dfde0c7945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:45Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Creating volume 35166313-d0ab-477c-adc7-c7dfde0c7945 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:51 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:51 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945 1073741824 Jul 05 19:57:51 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:51 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ada2927-7a91-45bc-9eea-7647b8daf339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208fc041-dd76-44f2-8a97-2879f66c9cb8', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:51 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57cf227-61d7-4e30-b0c8-2410dd7272e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:51 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Volume volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 (208fc041-dd76-44f2-8a97-2879f66c9cb8): created successfully Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57cf227-61d7-4e30-b0c8-2410dd7272e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Flow 'volume_create_manager' (274c6788-74ae-4d50-b36f-ae67d61d1831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-96f57961-3ad9-4c4b-8e0f-c70df8747260 tempest-CinderUnicodeTest-611605285 None] Created volume successfully. Jul 05 19:57:52 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD" returned: 1 in 0.781s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:57:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:52 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945 1073741824" returned: 0 in 0.867s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:52 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945 Jul 05 19:57:52 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:52 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Flow 'volume_create_manager' (d456bbe6-735b-4416-bd44-38d0c047025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471796b2-85cc-4d20-b82c-7c8e5785772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471796b2-85cc-4d20-b82c-7c8e5785772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-640716002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc7b19d-5a8d-491b-bc9b-7304616b2161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae687f74c9049ec8c0ae4498ae7c25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:53Z,use_quota=True,user_id='7516e0317adc448a84f5b555ff792004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e2df79-2e91-498b-9b0c-c373ad1c7c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e2df79-2e91-498b-9b0c-c373ad1c7c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37440976-3978-4c9f-b641-1d48b781d557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37440976-3978-4c9f-b641-1d48b781d557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc7b19d-5a8d-491b-bc9b-7304616b2161', 'volume_name': 'volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1ade49-b937-4ef6-81a4-eddbc9ba61ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1ade49-b937-4ef6-81a4-eddbc9ba61ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9347069-c396-45dd-9043-34bfc6e817a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:53 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Volume 6fc7b19d-5a8d-491b-bc9b-7304616b2161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161', 'volume_size': 1} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:53 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945" returned: 0 in 0.667s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.796s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690479562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757b8f8b-a20b-4f34-8c91-be1705545beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:45Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Creating volume 757b8f8b-a20b-4f34-8c91-be1705545beb {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:53 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac11e12-c115-45a5-9652-f1f3f37a0e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35166313-d0ab-477c-adc7-c7dfde0c7945', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:53 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb 1073741824 Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8fdb4-caa9-4474-a2ae-72e29ee77a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:53 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:53 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Volume volume-35166313-d0ab-477c-adc7-c7dfde0c7945 (35166313-d0ab-477c-adc7-c7dfde0c7945): created successfully Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8fdb4-caa9-4474-a2ae-72e29ee77a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (29785fd9-162d-427d-97f3-4811dde16d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-dc9d1236-b721-4ebc-822e-1f47a4e6e849 tempest-CreateVolumesFromImageTest-1559177592 None] Created volume successfully. Jul 05 19:57:54 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb 1073741824" returned: 0 in 0.795s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:54 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb Jul 05 19:57:54 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:54 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb" returned: 0 in 0.654s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.967s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032609619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d42b5e-dd24-426e-b652-b86a472556a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deafbddb4b93498f89a3bc9dc2b34ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:46Z,use_quota=True,user_id='5dd88ba2a28b4c68b22cce985ad88a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Creating volume 62d42b5e-dd24-426e-b652-b86a472556a0 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:54 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a128fbd-c6a6-494a-84f6-08c65442c64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757b8f8b-a20b-4f34-8c91-be1705545beb', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:54 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0 1073741824 Jul 05 19:57:54 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c22a88-bdbd-45d9-9c37-57b24933be74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:54 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Volume volume-757b8f8b-a20b-4f34-8c91-be1705545beb (757b8f8b-a20b-4f34-8c91-be1705545beb): created successfully Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c22a88-bdbd-45d9-9c37-57b24933be74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:54 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (a0ba5493-e06c-42bb-bfe1-e34b0f1a804a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-37f4a4d9-7433-4a7a-8bf7-9a7fa474466e tempest-CreateVolumesFromImageTest-1559177592 None] Created volume successfully. Jul 05 19:57:55 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0 1073741824" returned: 0 in 0.809s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:55 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0 Jul 05 19:57:55 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:56 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0" returned: 0 in 0.660s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.428s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1600128735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:48Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Creating volume df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:56 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09e0983-9ad6-40b8-ac0b-6280b1d3ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d42b5e-dd24-426e-b652-b86a472556a0', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:56 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d 1073741824 Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc73baa-20b4-4a7d-89c4-6efb3ecfd3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:56 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:56 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Volume volume-62d42b5e-dd24-426e-b652-b86a472556a0 (62d42b5e-dd24-426e-b652-b86a472556a0): created successfully Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc73baa-20b4-4a7d-89c4-6efb3ecfd3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Flow 'volume_create_manager' (ffce251c-0e3b-4f51-80f7-52363c285294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:56 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a6674853-2be3-4c69-b167-130e678a7ced tempest-CreateVolumesFromImageTest-1559177592 None] Created volume successfully. Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-62d42b5e-dd24-426e-b652-b86a472556a0-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-62d42b5e-dd24-426e-b652-b86a472556a0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-quobyte-62d42b5e-dd24-426e-b652-b86a472556a0" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-62d42b5e-dd24-426e-b652-b86a472556a0" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c282f6-f146-468c-97bc-ad8666d6ea9b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:57 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0 Jul 05 19:57:57 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:57 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d 1073741824" returned: 0 in 0.903s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:57 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d Jul 05 19:57:57 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:57 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0" returned: 0 in 0.793s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:57 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0 Jul 05 19:57:57 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:57 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d" returned: 0 in 0.648s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.568s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141071700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115dcce3-c812-411a-99a9-19140d2c7aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:48Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Creating volume 115dcce3-c812-411a-99a9-19140d2c7aa5 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:57 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:57 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5 1073741824 Jul 05 19:57:57 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:57 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ed2ad6-2101-4e1c-8373-7241dd15a33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aec4fc3-80be-41fd-b0f7-12533abab09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:58 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d (df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d): created successfully Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aec4fc3-80be-41fd-b0f7-12533abab09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (88ff55c9-cf37-4b03-8280-60b84244f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d3772caf-69b4-495e-bc99-bd59601d2b1d tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created volume successfully. Jul 05 19:57:58 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-62d42b5e-dd24-426e-b652-b86a472556a0" returned: 0 in 0.685s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-62d42b5e-dd24-426e-b652-b86a472556a0" released by "delete_volume" :: held 1.519s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Created reservations ['a186c86a-0bf9-40c0-80cd-4fc16e95a190', 'bca83750-fd1f-4f7c-8815-353fc0613dbd', '8cf477bc-7c69-4e61-ae56-4cef68a58a83', '5e5dcfdd-5f23-442e-b6fb-fce8a0382f07'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:58 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:57:58 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:58 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5 1073741824" returned: 0 in 0.900s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:58 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5 Jul 05 19:57:58 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-757b8f8b-a20b-4f34-8c91-be1705545beb-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-757b8f8b-a20b-4f34-8c91-be1705545beb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-quobyte-757b8f8b-a20b-4f34-8c91-be1705545beb" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-757b8f8b-a20b-4f34-8c91-be1705545beb" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d20a52-0d1c-47e2-8575-86b03e07029d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:59 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.760s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:57:59 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Deleted volume successfully. Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-267c890f-51b6-48f0-92b7-238eaa988ca9 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-62d42b5e-dd24-426e-b652-b86a472556a0-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:57:59 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb Jul 05 19:57:59 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:59 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5" returned: 0 in 0.734s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.681s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1270245939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd35d42-9d93-4da6-88b0-7dd176468b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:49Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Creating volume abd35d42-9d93-4da6-88b0-7dd176468b86 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:57:59 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d924f3-f8c8-4928-b6e2-dc0ea18f6412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115dcce3-c812-411a-99a9-19140d2c7aa5', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:59 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86 1073741824 Jul 05 19:57:59 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab5dbf7-c36c-4fea-82c6-7e949cc2f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:57:59 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume volume-115dcce3-c812-411a-99a9-19140d2c7aa5 (115dcce3-c812-411a-99a9-19140d2c7aa5): created successfully Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab5dbf7-c36c-4fea-82c6-7e949cc2f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:57:59 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (b70f29b5-f064-4d23-85f9-a309a4164e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:57:59 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-46cf2f74-d04a-41c3-9c22-ecc1a8e56702 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created volume successfully. Jul 05 19:58:00 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb" returned: 0 in 0.786s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:00 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb Jul 05 19:58:00 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:00 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86 1073741824" returned: 0 in 0.886s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:00 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86 Jul 05 19:58:00 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:00 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-757b8f8b-a20b-4f34-8c91-be1705545beb" returned: 0 in 0.685s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-757b8f8b-a20b-4f34-8c91-be1705545beb" released by "delete_volume" :: held 1.520s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Created reservations ['b0d4d8f1-3bbd-42c7-9199-b217a6b241c5', 'efc3ad01-ee8b-4a8d-949f-908c3f2a00ae', 'df05788c-c5ad-4080-8bbf-50b5c05741ef', 'a01a28aa-cf3a-457c-b367-c866156f9106'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:01 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:01 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:01 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86" returned: 0 in 0.653s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.775s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663601266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46d4a5c-bf1a-472d-a243-764fe456f4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:49Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Creating volume f46d4a5c-bf1a-472d-a243-764fe456f4ca {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:01 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8e6c24-d2d2-4f11-8341-0069e7a11b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd35d42-9d93-4da6-88b0-7dd176468b86', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773c259c-1483-49bb-8e97-945af14759d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:01 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca 1073741824 Jul 05 19:58:01 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:01 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume volume-abd35d42-9d93-4da6-88b0-7dd176468b86 (abd35d42-9d93-4da6-88b0-7dd176468b86): created successfully Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773c259c-1483-49bb-8e97-945af14759d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (87a5d535-d3f2-4d0c-8877-7a0025a47645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-bf8e4283-09cd-415d-9746-f3341a5e61a9 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created volume successfully. Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-35166313-d0ab-477c-adc7-c7dfde0c7945-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-35166313-d0ab-477c-adc7-c7dfde0c7945-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-quobyte-35166313-d0ab-477c-adc7-c7dfde0c7945" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-35166313-d0ab-477c-adc7-c7dfde0c7945" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:01 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6290a20-b04d-4bd2-9214-a9dca98bb160]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.673s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Deleted volume successfully. Jul 05 19:58:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-80643491-743f-4962-ba06-c82b0b0e9d3a tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-757b8f8b-a20b-4f34-8c91-be1705545beb-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:01 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945 Jul 05 19:58:01 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:02 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca 1073741824" returned: 0 in 0.897s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:02 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca Jul 05 19:58:02 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:02 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945" returned: 0 in 0.791s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:02 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945 Jul 05 19:58:02 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:02 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca" returned: 0 in 0.646s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.060s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-727323814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7e2b6a-10e8-400f-ae2b-45370163311b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69033e6161aa404182dc49a6e00bdc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:50Z,use_quota=True,user_id='7a7eae0fb0d7432d9e0d0aeebe11a35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Creating volume 5c7e2b6a-10e8-400f-ae2b-45370163311b {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:02 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:02 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b 1073741824 Jul 05 19:58:02 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1c440e-2ca7-42e3-b895-c50006003332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1dd314-7b2e-4b33-8dd4-418bd1170a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:02 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca (f46d4a5c-bf1a-472d-a243-764fe456f4ca): created successfully Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1dd314-7b2e-4b33-8dd4-418bd1170a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (9bff5aa4-5ed8-41f4-8012-519981651f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fcc88a80-e361-494f-8ba3-6d0ab2aaaccb tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created volume successfully. Jul 05 19:58:03 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-35166313-d0ab-477c-adc7-c7dfde0c7945" returned: 0 in 0.699s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-35166313-d0ab-477c-adc7-c7dfde0c7945" released by "delete_volume" :: held 1.531s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Created reservations ['25ca4265-005f-403c-b2dd-a7633afdff90', '9761794c-aee7-4894-ba2f-3bb488d2d7b9', 'ae23afe4-f62d-46dd-974d-278806b8c10b', '752de84f-7ff7-47ea-a037-804a03817f9f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:03 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:03 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:03 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b 1073741824" returned: 0 in 0.910s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-1e83e823-490d-4824-afe4-877755642a09-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:03 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b Jul 05 19:58:03 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-1e83e823-490d-4824-afe4-877755642a09-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-quobyte-1e83e823-490d-4824-afe4-877755642a09" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-1e83e823-490d-4824-afe4-877755642a09" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ed66e-9987-44c5-b477-367f8c8c6b75]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:04 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.737s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:04 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09 Jul 05 19:58:04 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:04 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Deleted volume successfully. Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9db9ab05-184e-4ffa-918c-58a447a94409 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-35166313-d0ab-477c-adc7-c7dfde0c7945-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:04 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b" returned: 0 in 0.691s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d900db53-99bc-4d54-9ee9-c650df6dadb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053a8bb27a2744eaa9447b9d9e5db05d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:49Z,use_quota=True,user_id='6ef25e2d8ed3403ca4a96c8f15fc29de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b822a10-6eb0-4d18-a68e-24534c3d2c3f),volume_type_id=5b822a10-6eb0-4d18-a68e-24534c3d2c3f)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Creating volume d900db53-99bc-4d54-9ee9-c650df6dadb7 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:04 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6be07d-dd3d-4daf-a0eb-13f390486041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7e2b6a-10e8-400f-ae2b-45370163311b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:04 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 1073741824 Jul 05 19:58:04 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c092cd-07cf-493a-8974-d577cb509028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:04 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Volume volume-5c7e2b6a-10e8-400f-ae2b-45370163311b (5c7e2b6a-10e8-400f-ae2b-45370163311b): created successfully Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c092cd-07cf-493a-8974-d577cb509028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Flow 'volume_create_manager' (15a9b779-39c6-4add-b97c-7d09d3faf9ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:04 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-59209136-0560-4172-9d0a-6210e0d20acd tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created volume successfully. Jul 05 19:58:04 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09" returned: 0 in 0.774s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:04 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09 Jul 05 19:58:04 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-5c7e2b6a-10e8-400f-ae2b-45370163311b-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-5c7e2b6a-10e8-400f-ae2b-45370163311b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-quobyte-5c7e2b6a-10e8-400f-ae2b-45370163311b" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-5c7e2b6a-10e8-400f-ae2b-45370163311b" acquired by "delete_volume" :: waited 0.029s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af430ea-e084-405b-a5c0-9bfdd71999a6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:05 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b Jul 05 19:58:05 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:05 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 1073741824" returned: 0 in 0.917s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:05 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1e83e823-490d-4824-afe4-877755642a09" returned: 0 in 0.743s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-1e83e823-490d-4824-afe4-877755642a09" released by "delete_volume" :: held 1.559s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:05 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 Jul 05 19:58:05 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Created reservations ['4e251e78-18c8-4773-9139-708aa37a455d', '4e4b8d68-cfe6-4e85-8ffb-f2c01ffe1861', '3d88376c-e9aa-428b-aac9-7e45dc92fd0c', 'd49259c9-749f-42a6-88b5-c59d438b2c53'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:05 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:05 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:05 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b" returned: 0 in 0.811s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:05 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b Jul 05 19:58:05 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-9f135767-18ad-406c-ab0d-363ad8be03c5-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-9f135767-18ad-406c-ab0d-363ad8be03c5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "cinder-quobyte-9f135767-18ad-406c-ab0d-363ad8be03c5" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-9f135767-18ad-406c-ab0d-363ad8be03c5" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b4b45a-e674-4d25-aada-f9fdc803cdd4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:06 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7" returned: 0 in 0.772s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.151s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:57:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-640716002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc7b19d-5a8d-491b-bc9b-7304616b2161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae687f74c9049ec8c0ae4498ae7c25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:57:53Z,use_quota=True,user_id='7516e0317adc448a84f5b555ff792004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Creating volume 6fc7b19d-5a8d-491b-bc9b-7304616b2161 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:06 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Attempting download of ca9bfc65-5194-4ae3-80c9-4cdb31a36fee ((None, [{'url': 'file:///opt/stack/data/glance/images/ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'metadata': {}}])) to volume d900db53-99bc-4d54-9ee9-c650df6dadb7. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 19:58:06 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 1073741824 Jul 05 19:58:06 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:06 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:06 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Deleted volume successfully. Jul 05 19:58:06 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5 Jul 05 19:58:06 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c283612e-7370-487e-b649-2422e9dfb935]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_t6at30_p {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-86777f95-9911-4a95-be5c-5f2ec1259765 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-1e83e823-490d-4824-afe4-877755642a09-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:06 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5c7e2b6a-10e8-400f-ae2b-45370163311b" returned: 0 in 0.751s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-5c7e2b6a-10e8-400f-ae2b-45370163311b" released by "delete_volume" :: held 1.619s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:06 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_t6at30_p Jul 05 19:58:06 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created reservations ['9ed0a910-a034-4d45-ab73-6be018fca7e4', 'fd8dc9ed-8683-4573-a231-cd58456c1a48', '94ce0190-9d4b-438f-8136-1fefc7507f02', '0144942a-2a3c-4a7e-8a20-abe935875845'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:06 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:06 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-f46d4a5c-bf1a-472d-a243-764fe456f4ca-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-f46d4a5c-bf1a-472d-a243-764fe456f4ca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-quobyte-f46d4a5c-bf1a-472d-a243-764fe456f4ca" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-f46d4a5c-bf1a-472d-a243-764fe456f4ca" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ad00c7-783d-4b10-a333-b9f03ac55640]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:07 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5" returned: 0 in 1.145s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:07 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_t6at30_p" returned: 0 in 0.997s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_t6at30_p {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:07 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5 Jul 05 19:58:07 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:07 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca Jul 05 19:58:07 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:07 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 1073741824" returned: 0 in 1.241s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:07 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_t6at30_p Jul 05 19:58:07 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:07 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.903s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:07 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 Jul 05 19:58:07 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:07 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Deleted volume successfully. Jul 05 19:58:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d8a25980-779c-491e-9ed7-1fd532e83c69 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-5c7e2b6a-10e8-400f-ae2b-45370163311b-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:08 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:08 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9f135767-18ad-406c-ab0d-363ad8be03c5" returned: 0 in 0.860s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca" returned: 0 in 0.928s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-quobyte-9f135767-18ad-406c-ab0d-363ad8be03c5" released by "delete_volume" :: held 2.082s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:08 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_t6at30_p" returned: 1 in 0.886s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_t6at30_p' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:58:08 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca Jul 05 19:58:08 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28ab917-75df-4fbf-ad2e-a167802bc539]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:08 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161" returned: 0 in 0.757s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9347069-c396-45dd-9043-34bfc6e817a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc98493-727a-492c-b18d-7b31da905587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:08 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Volume volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 (6fc7b19d-5a8d-491b-bc9b-7304616b2161): created successfully Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc98493-727a-492c-b18d-7b31da905587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Flow 'volume_create_manager' (d456bbe6-735b-4416-bd44-38d0c047025e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:08 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b8ada8a3-48d9-47ee-bd4f-d0cce2e795c9 tempest-CinderUnicodeTest-611605285 None] Created volume successfully. Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Created reservations ['cc8c2e52-efa5-48db-b486-77d79eda5302', '3c13684e-d7d0-4e0e-98c9-58d0e5fa600f', '3860beb7-b5fd-4946-873d-fe6f5a58f3d5', 'b3837f92-1d4d-4b63-a1a8-5b3f075b5132'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:08 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD Jul 05 19:58:08 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:08 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:08 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:08 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-f46d4a5c-bf1a-472d-a243-764fe456f4ca" returned: 0 in 0.733s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-f46d4a5c-bf1a-472d-a243-764fe456f4ca" released by "delete_volume" :: held 1.716s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created reservations ['165d6501-3f0c-4ba8-b314-67fa05c16f7c', '72f20e7a-320e-4b03-aad4-10e8e1e5fd53', 'cb98ff58-2063-4c06-99c0-22cc18b33195', 'b09c3965-55a9-4acc-8d48-8c0958ddb625'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:09 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:09 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.713s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:09 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Deleted volume successfully. Jul 05 19:58:09 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:09 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:09 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD Jul 05 19:58:09 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1593a802-2c54-47dd-be61-d5cfb038c1c3 tempest-CreateVolumesFromImageTest-1559177592 None] Lock "cinder-9f135767-18ad-406c-ab0d-363ad8be03c5-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Creating offline snapshot 429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 of volume 6fc7b19d-5a8d-491b-bc9b-7304616b2161 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-abd35d42-9d93-4da6-88b0-7dd176468b86-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa42f2b4-7af3-4a39-8f70-5d85b13bed1a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-abd35d42-9d93-4da6-88b0-7dd176468b86-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-quobyte-abd35d42-9d93-4da6-88b0-7dd176468b86" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:09 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-abd35d42-9d93-4da6-88b0-7dd176468b86" acquired by "delete_volume" :: waited 0.034s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:09 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[749bf5e4-ef4a-4c1b-85b4-258317ae8e0b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:09 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86 Jul 05 19:58:09 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:10 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.954s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:10 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Deleted volume successfully. Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-58baf4b8-c96e-4a56-b7fb-a3ce53ddf006 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-f46d4a5c-bf1a-472d-a243-764fe456f4ca-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:10 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD" returned: 1 in 1.105s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] ca9bfc65-5194-4ae3-80c9-4cdb31a36fee was raw, converting to raw {{(pid=86389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:10 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 Jul 05 19:58:10 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:10 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161" returned: 0 in 0.939s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:10 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 1G Jul 05 19:58:10 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:10 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86" returned: 0 in 1.066s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:10 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86 Jul 05 19:58:10 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:11 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7" returned: 0 in 0.943s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca9bfc65-5194-4ae3-80c9-4cdb31a36fee_52hoffendevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:58:11 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:11 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 1G Jul 05 19:58:11 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:11 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 1G" returned: 0 in 1.146s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:11 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 Jul 05 19:58:11 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:11 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-abd35d42-9d93-4da6-88b0-7dd176468b86" returned: 0 in 0.897s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-abd35d42-9d93-4da6-88b0-7dd176468b86" released by "delete_volume" :: held 2.028s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created reservations ['876bcc98-28f8-4dc5-ad03-416e7379338c', 'e32eb25b-744e-493b-a13a-cf542bcdb2bd', '5e35aba3-fbbd-4b86-996d-48628d508577', '34304e13-ba39-4085-b9bc-ae556f34d22a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:11 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:11 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:12 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 1G" returned: 0 in 0.967s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2b4230-bad8-4733-ac63-e8e436f4704d]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:12 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 Jul 05 19:58:12 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:12 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4" returned: 0 in 0.889s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:12 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 is being set with open permissions: ugo+rw Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:12 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 Jul 05 19:58:12 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:12 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.817s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:12 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Deleted volume successfully. Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-4390750d-d6a2-474b-bea2-4f2980935524 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-abd35d42-9d93-4da6-88b0-7dd176468b86-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-115dcce3-c812-411a-99a9-19140d2c7aa5-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-115dcce3-c812-411a-99a9-19140d2c7aa5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-quobyte-115dcce3-c812-411a-99a9-19140d2c7aa5" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-115dcce3-c812-411a-99a9-19140d2c7aa5" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[267dc2ee-f2e3-427e-98dd-49933b0c6290]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:13 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7" returned: 0 in 1.008s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:13 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5 Jul 05 19:58:13 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:13 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4" returned: 0 in 0.813s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:13 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 Jul 05 19:58:13 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:13 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.info Jul 05 19:58:13 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (8cac4f90-4f0f-4c2a-8894-de7ff591eeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284794d1-0640-4d78-9b5d-0944e9a1c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284794d1-0640-4d78-9b5d-0944e9a1c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934832874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3b10b3-baed-4834-be30-83f7bd718fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:13Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23760f3-1916-42f0-b5cb-655df28a992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23760f3-1916-42f0-b5cb-655df28a992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d993fe43-b544-49c2-9ea1-16be86e3b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d993fe43-b544-49c2-9ea1-16be86e3b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3b10b3-baed-4834-be30-83f7bd718fe3', 'volume_name': 'volume-bc3b10b3-baed-4834-be30-83f7bd718fe3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d6b0b0-f605-46ed-b9c1-85e4511f33ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d6b0b0-f605-46ed-b9c1-85e4511f33ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f21ce26-5235-47cc-a7f2-d2cf94629167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:13 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume bc3b10b3-baed-4834-be30-83f7bd718fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3b10b3-baed-4834-be30-83f7bd718fe3', 'volume_size': 1} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:13 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5" returned: 0 in 0.937s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:14 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5 Jul 05 19:58:14 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:14 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7" returned: 1 in 0.885s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Downloaded image ca9bfc65-5194-4ae3-80c9-4cdb31a36fee ((None, [{'url': 'file:///opt/stack/data/glance/images/ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'metadata': {}}])) to volume d900db53-99bc-4d54-9ee9-c650df6dadb7 successfully. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Temporary image ca9bfc65-5194-4ae3-80c9-4cdb31a36fee for user 6ef25e2d8ed3403ca4a96c8f15fc29de is deleted. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Marking volume d900db53-99bc-4d54-9ee9-c650df6dadb7 as bootable. {{(pid=86389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Copying metadata from image ca9bfc65-5194-4ae3-80c9-4cdb31a36fee to d900db53-99bc-4d54-9ee9-c650df6dadb7. {{(pid=86389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Creating volume glance metadata for volume d900db53-99bc-4d54-9ee9-c650df6dadb7 backed by image ca9bfc65-5194-4ae3-80c9-4cdb31a36fee with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4d3ff4ef7d953697bcf3fbc70ae5d741', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923d755a-3a3f-4b2a-84c1-36c41232dd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d900db53-99bc-4d54-9ee9-c650df6dadb7', 'volume_size': 1, 'image_id': 'ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d3ff4ef7d953697bcf3fbc70ae5d741', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '053a8bb27a2744eaa9447b9d9e5db05d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0e8ac03ee6222c385d5c25647a78326624c6e0aebf83570562438e179080c5aa570560efe00720057606cb40dc20452a63e3830db444a8acb0f686e214db230', 'id': 'ca9bfc65-5194-4ae3-80c9-4cdb31a36fee', 'created_at': datetime.datetime(2026, 7, 5, 17, 57, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 57, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca9bfc65-5194-4ae3-80c9-4cdb31a36fee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5875fe-d248-4848-ace8-03e41e9b69ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:14 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Volume volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 (d900db53-99bc-4d54-9ee9-c650df6dadb7): created successfully Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5875fe-d248-4848-ace8-03e41e9b69ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:14 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Flow 'volume_create_manager' (01bd9ef7-a04a-4179-940f-9ec80dc9aa29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.info" returned: 0 in 0.793s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:14 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.info is being set with open permissions: ugo+rw Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:14 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1e7de53d-3955-4917-a8c9-ce61e15df081 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Created volume successfully. Jul 05 19:58:14 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.info Jul 05 19:58:14 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Acquiring lock "cinder-d900db53-99bc-4d54-9ee9-c650df6dadb7-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "cinder-d900db53-99bc-4d54-9ee9-c650df6dadb7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Acquiring lock "cinder-quobyte-d900db53-99bc-4d54-9ee9-c650df6dadb7" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "cinder-quobyte-d900db53-99bc-4d54-9ee9-c650df6dadb7" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[07992c97-2b8a-4a6e-99b7-87f8b9100380]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:14 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-115dcce3-c812-411a-99a9-19140d2c7aa5" returned: 0 in 0.749s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-115dcce3-c812-411a-99a9-19140d2c7aa5" released by "delete_volume" :: held 1.742s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:14 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 Jul 05 19:58:14 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created reservations ['9bf6fc03-7087-4b46-a8ac-5c39262ddf10', 'a8b213a6-ff62-416c-b2d1-15cce78c536b', 'dac2fb6d-7d78-4b3c-bf20-9e356553e20e', '93147609-5338-47fa-8ba2-004ba8b87d3a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:14 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.info" returned: 0 in 0.712s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:14 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:14 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.450s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934832874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3b10b3-baed-4834-be30-83f7bd718fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:13Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Creating volume bc3b10b3-baed-4834-be30-83f7bd718fe3 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:14 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:14 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 1073741824 Jul 05 19:58:14 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:14 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-118c7f09-576d-489c-b3fa-8f950d173a16 tempest-CinderUnicodeTest-611605285 None] Create snapshot completed successfully Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-quobyte-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d" acquired by "delete_volume" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[442f060f-df1a-44ec-880e-17823b27ef0e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:15 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d Jul 05 19:58:15 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:15 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7" returned: 0 in 0.895s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:15 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.734s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Deleted volume successfully. Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c1a21c99-b416-4ccc-847b-c056337e4512 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-115dcce3-c812-411a-99a9-19140d2c7aa5-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:15 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 Jul 05 19:58:15 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Acquiring lock "cinder-429c6c88-c09d-4f1f-8d5b-d34a25ae5db4-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Lock "cinder-429c6c88-c09d-4f1f-8d5b-d34a25ae5db4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Acquiring lock "cinder-quobyte-6fc7b19d-5a8d-491b-bc9b-7304616b2161" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Lock "cinder-quobyte-6fc7b19d-5a8d-491b-bc9b-7304616b2161" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Acquiring lock "cinder-quobyte-429c6c88-c09d-4f1f-8d5b-d34a25ae5db4" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Lock "cinder-quobyte-429c6c88-c09d-4f1f-8d5b-d34a25ae5db4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Deleting offline snapshot 429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 of volume 6fc7b19d-5a8d-491b-bc9b-7304616b2161 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] snapshot_file for this snap is: volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:58:15 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5151d5ce-3265-47e5-9e3a-c593d97a163c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 1073741824" returned: 0 in 1.035s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:16 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 Jul 05 19:58:16 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:16 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 Jul 05 19:58:16 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:16 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:16 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:16 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d" returned: 0 in 1.032s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:16 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d Jul 05 19:58:16 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:16 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7" returned: 1 in 1.112s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:16 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7 Jul 05 19:58:16 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:16 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3" returned: 0 in 0.959s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f21ce26-5235-47cc-a7f2-d2cf94629167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3b10b3-baed-4834-be30-83f7bd718fe3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2988a729-23d9-4669-a584-2a3fc2c56e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:17 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 (bc3b10b3-baed-4834-be30-83f7bd718fe3): created successfully Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2988a729-23d9-4669-a584-2a3fc2c56e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (8cac4f90-4f0f-4c2a-8894-de7ff591eeef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0d8e850d-dcda-48a8-a854-63864d1b4203 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created volume successfully. Jul 05 19:58:17 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d" returned: 0 in 0.756s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d" released by "delete_volume" :: held 1.845s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:17 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.925s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created reservations ['068e6466-826e-46be-91dc-5d81e064a5e2', 'faa8d062-b1ff-48f6-a045-bbbb915642fb', '0370ef33-1cc6-40f2-a70f-f2a524287718', '09557ac1-f35c-4736-8a31-52785b8d8b68'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:17 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4" returned: 0 in 1.250s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[297811b2-0d5c-4f7e-84d8-5e3fcb882fdc]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:17 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:17 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:17 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 Jul 05 19:58:17 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-e24ac3f7-e863-4a3e-b944-0d94a0056f33-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-e24ac3f7-e863-4a3e-b944-0d94a0056f33-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:17 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-d900db53-99bc-4d54-9ee9-c650df6dadb7" returned: 0 in 0.858s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "cinder-quobyte-e24ac3f7-e863-4a3e-b944-0d94a0056f33" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "cinder-quobyte-d900db53-99bc-4d54-9ee9-c650df6dadb7" released by "delete_volume" :: held 2.933s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-e24ac3f7-e863-4a3e-b944-0d94a0056f33" acquired by "delete_volume" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[88804182-4dfc-4263-a1b0-e7bf9255151b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Created reservations ['d52fcfac-69d8-45a1-b96c-4c1f4ede7077', 'c1d9f69f-73dc-45ce-b718-b93b78df1e69', 'db505700-8959-4235-825f-35ab094c0d14', 'ed0fe5b2-43ac-4220-a4c8-e2ed388c8d01'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:17 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 Jul 05 19:58:17 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:17 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:17 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:18 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.823s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:18 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Deleted volume successfully. Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-79ca3173-d495-429c-a13b-c59387f74d59 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-df18eacc-71d1-45bd-ae6b-bc3c2e5b0a0d-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Creating offline snapshot 438845f8-0764-458f-8b06-a5a5c377114d of volume bc3b10b3-baed-4834-be30-83f7bd718fe3 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[654fcf2a-3c34-4233-b2ec-a5b27ac73537]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:18 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 Jul 05 19:58:18 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:18 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161" returned: 0 in 1.319s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:18 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 Jul 05 19:58:18 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:18 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.979s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:18 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Deleted volume successfully. Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-973c64c8-f87d-48c3-b350-de28f5069026 tempest-VolumeAndVolumeTypeFromImageTest-2051071772 None] Lock "cinder-d900db53-99bc-4d54-9ee9-c650df6dadb7-delete_volume" released by "delete_volume" :: held 4.262s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:18 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33" returned: 0 in 1.282s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:18 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33 Jul 05 19:58:18 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:19 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3" returned: 0 in 1.003s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:19 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d 1G Jul 05 19:58:19 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:19 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4" returned: 0 in 0.989s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:19 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4 Jul 05 19:58:19 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:19 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e24ac3f7-e863-4a3e-b944-0d94a0056f33" returned: 0 in 0.778s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-quobyte-e24ac3f7-e863-4a3e-b944-0d94a0056f33" released by "delete_volume" :: held 2.124s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Created reservations ['42fba0a6-2a34-46b2-93da-f573d9a07fcd', 'e7f5259b-ce16-4b13-9e8f-ff04c596e3ef', 'b973a548-8e11-47c5-8ef7-be4c3e2e9436', '67a68522-d85f-40ff-b053-59367bdf3daa'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:19 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:19 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:20 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161.429c6c88-c09d-4f1f-8d5b-d34a25ae5db4" returned: 0 in 0.814s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:20 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d 1G" returned: 0 in 1.101s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Lock "cinder-quobyte-429c6c88-c09d-4f1f-8d5b-d34a25ae5db4" released by "_delete_snapshot" :: held 4.522s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Lock "cinder-quobyte-6fc7b19d-5a8d-491b-bc9b-7304616b2161" released by "delete_snapshot" :: held 4.552s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:20 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d Jul 05 19:58:20 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Created reservations ['c606e0b9-1b54-407b-aa96-4b126a38cf69', '4e285e1e-c885-4945-a9f9-d9778951dfa9', '630fed36-5c68-45af-85df-9b7a097498f7', 'a7b8b880-c135-4af5-8741-9fd7c73df722'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Delete snapshot completed successfully. Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-be03df3f-aef0-422b-8cfb-0b12163ee09c tempest-CinderUnicodeTest-611605285 None] Lock "cinder-429c6c88-c09d-4f1f-8d5b-d34a25ae5db4-delete_snapshot" released by "delete_snapshot" :: held 4.763s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:20 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.897s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Deleted volume successfully. Jul 05 19:58:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f2d67b0c-ae71-462c-a52b-b01c34816585 tempest-CreateVolumesFromSourceVolumeTest-286587535 None] Lock "cinder-e24ac3f7-e863-4a3e-b944-0d94a0056f33-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "cinder-6fc7b19d-5a8d-491b-bc9b-7304616b2161-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Lock "cinder-6fc7b19d-5a8d-491b-bc9b-7304616b2161-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "cinder-quobyte-6fc7b19d-5a8d-491b-bc9b-7304616b2161" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:21 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d" returned: 0 in 0.931s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Lock "cinder-quobyte-6fc7b19d-5a8d-491b-bc9b-7304616b2161" acquired by "delete_volume" :: waited 0.035s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:21 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d is being set with open permissions: ugo+rw Jul 05 19:58:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:21 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ef78b-f9d9-40b1-99c4-3cf08bc990e0]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:21 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d Jul 05 19:58:21 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:21 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 Jul 05 19:58:21 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:22 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d" returned: 0 in 0.808s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:22 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.info Jul 05 19:58:22 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:22 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161" returned: 0 in 1.146s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:22 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161 Jul 05 19:58:22 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:23 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.info" returned: 0 in 0.794s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:23 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.info is being set with open permissions: ugo+rw Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:23 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.info Jul 05 19:58:23 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:23 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-6fc7b19d-5a8d-491b-bc9b-7304616b2161" returned: 0 in 0.704s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Lock "cinder-quobyte-6fc7b19d-5a8d-491b-bc9b-7304616b2161" released by "delete_volume" :: held 1.955s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Created reservations ['a2b18559-89e1-4b31-8704-083f23d8525a', '8b5dd83e-47ba-4e70-b7eb-da392850f40a', '857b6987-3edb-47d5-acfa-f62f5c84ed95', 'c4e47db9-5eac-497a-85d8-7c15f0d3c841'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:23 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:23 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "cinder-208fc041-dd76-44f2-8a97-2879f66c9cb8-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Lock "cinder-208fc041-dd76-44f2-8a97-2879f66c9cb8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "cinder-quobyte-208fc041-dd76-44f2-8a97-2879f66c9cb8" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Lock "cinder-quobyte-208fc041-dd76-44f2-8a97-2879f66c9cb8" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dcd529-9e1f-49c9-b8ac-95533d209c0c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Flow 'volume_create_manager' (9513edca-faeb-4968-bf48-09ecc3e9f5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2692faf-91a7-40da-9d45-182b7ba53e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2692faf-91a7-40da-9d45-182b7ba53e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-678284357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9351e7d9-6f07-4f47-9572-1d7c2dd492bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d95f1572db4f79a5a8d2204af61eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:24Z,use_quota=True,user_id='4aa22ad73b94451890e6a4a797d022a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5b2635-05cc-4b38-b916-586b9bb45e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5b2635-05cc-4b38-b916-586b9bb45e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ec7417-7023-4878-9617-597978ebee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ec7417-7023-4878-9617-597978ebee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9351e7d9-6f07-4f47-9572-1d7c2dd492bb', 'volume_name': 'volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:23 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 Jul 05 19:58:23 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80101e25-4373-46fc-b4a2-5006879f9c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80101e25-4373-46fc-b4a2-5006879f9c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:23 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3f8efa-a57d-4b31-9f0e-29fb24e1b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:23 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Volume 9351e7d9-6f07-4f47-9572-1d7c2dd492bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb', 'volume_size': 1} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.info" returned: 0 in 0.938s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.755s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-678284357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9351e7d9-6f07-4f47-9572-1d7c2dd492bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d95f1572db4f79a5a8d2204af61eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:24Z,use_quota=True,user_id='4aa22ad73b94451890e6a4a797d022a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Creating volume 9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:24 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d50154a4-211d-4375-b28f-4624bbf8e623 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Create snapshot completed successfully Jul 05 19:58:24 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb 1073741824 Jul 05 19:58:24 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:24 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.822s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Deleted volume successfully. Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3e815317-9a40-49f2-be8e-1ae631ca0c12 tempest-CinderUnicodeTest-611605285 None] Lock "cinder-6fc7b19d-5a8d-491b-bc9b-7304616b2161-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:24 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8" returned: 0 in 1.047s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:24 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8 Jul 05 19:58:24 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:25 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb 1073741824" returned: 0 in 1.133s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:25 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb Jul 05 19:58:25 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (67153250-49bb-45be-931b-293a128f3bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15db89cb-b103-4c3b-b1c3-0f6c72c4d55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15db89cb-b103-4c3b-b1c3-0f6c72c4d55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582123886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c69a72-69b1-41bf-8ad5-2a3e9940a766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:25Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5aeee5-eb82-4866-933f-de9014cba928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5aeee5-eb82-4866-933f-de9014cba928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12f092f-1a62-4bc8-8fe7-1ef4fabd991c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12f092f-1a62-4bc8-8fe7-1ef4fabd991c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c69a72-69b1-41bf-8ad5-2a3e9940a766', 'volume_name': 'volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba706a8b-f1c7-47da-87c1-4ebac93c849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba706a8b-f1c7-47da-87c1-4ebac93c849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a382a0-4a94-4d48-9661-ab5233f23b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume 08c69a72-69b1-41bf-8ad5-2a3e9940a766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766', 'volume_size': 1} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:25 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-208fc041-dd76-44f2-8a97-2879f66c9cb8" returned: 0 in 0.909s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (7f2f7a86-5a44-40c6-92a9-6f410beb12e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e5ca1a-3038-4490-a76a-15de3970ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Lock "cinder-quobyte-208fc041-dd76-44f2-8a97-2879f66c9cb8" released by "delete_volume" :: held 2.063s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e5ca1a-3038-4490-a76a-15de3970ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1885795356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb713ea-bd15-4f88-8063-78fc761995ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:26Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8abde0-0b31-4f89-8fc0-2e2032c97b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8abde0-0b31-4f89-8fc0-2e2032c97b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e5c26b-4436-4c24-a234-d12293254a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e5c26b-4436-4c24-a234-d12293254a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb713ea-bd15-4f88-8063-78fc761995ab', 'volume_name': 'volume-7cb713ea-bd15-4f88-8063-78fc761995ab', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd643d8-b460-4b45-9685-d902d78bc7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd643d8-b460-4b45-9685-d902d78bc7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a6af81-4f26-43a4-be1f-e770a0c39426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:25 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume 7cb713ea-bd15-4f88-8063-78fc761995ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb713ea-bd15-4f88-8063-78fc761995ab', 'volume_size': 1} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:25 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Created reservations ['5193bae9-faa4-42f6-96c9-ee91ab0c4583', 'ca9bde49-607c-45de-9ce2-75c7098d5f49', 'ef15a422-75e8-4b20-add7-612c884725ba', '634f6e83-47d7-46b8-8ac9-eeaa5acaa58e'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (67282850-7937-4e50-8734-f0724934657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5604ddd-c04f-47a4-985e-4596ba2817c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5604ddd-c04f-47a4-985e-4596ba2817c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276995672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c391822f-0e1c-423d-920d-4499e1d288f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:26Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edce333-27cc-481a-9aea-a0c83fb1cf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edce333-27cc-481a-9aea-a0c83fb1cf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26263085-34ce-4ec7-b26a-bf2d68e20236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26263085-34ce-4ec7-b26a-bf2d68e20236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c391822f-0e1c-423d-920d-4499e1d288f7', 'volume_name': 'volume-c391822f-0e1c-423d-920d-4499e1d288f7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8e821f-fbd8-4263-b82d-620e94bda136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8e821f-fbd8-4263-b82d-620e94bda136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3c6b83-d450-4891-8442-34dea2b69cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume c391822f-0e1c-423d-920d-4499e1d288f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c391822f-0e1c-423d-920d-4499e1d288f7', 'volume_size': 1} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" returned: 0 in 0.982s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582123886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c69a72-69b1-41bf-8ad5-2a3e9940a766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:25Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Creating volume 08c69a72-69b1-41bf-8ad5-2a3e9940a766 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:26 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:26 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:26 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3f8efa-a57d-4b31-9f0e-29fb24e1b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32b06e5-8895-47dc-a097-c0925f33486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 1073741824 Jul 05 19:58:26 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:26 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Volume volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb (9351e7d9-6f07-4f47-9572-1d7c2dd492bb): created successfully Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32b06e5-8895-47dc-a097-c0925f33486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Flow 'volume_create_manager' (9513edca-faeb-4968-bf48-09ecc3e9f5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d612452e-4c25-40b6-b7ce-fcf6659a0257 tempest-VolumeDependencyTests-1214949651 None] Created volume successfully. Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (9dc09c17-fba3-4529-b6bf-171cddcba625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db4ee7b-c74a-4115-856e-1a581c9c9b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db4ee7b-c74a-4115-856e-1a581c9c9b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775716600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c323ffc-78f3-418b-96ba-1579e552342e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:27Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ac0a38-ebf1-4e9d-b979-5527834db030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ac0a38-ebf1-4e9d-b979-5527834db030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eba362-2a43-4f80-8420-b610d877dc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eba362-2a43-4f80-8420-b610d877dc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c323ffc-78f3-418b-96ba-1579e552342e', 'volume_name': 'volume-9c323ffc-78f3-418b-96ba-1579e552342e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fb9875-fcf3-4ba5-b53b-cd21170c5a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fb9875-fcf3-4ba5-b53b-cd21170c5a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0e9890-0e55-4ec8-8b94-0d7d1d29dbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:26 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume 9c323ffc-78f3-418b-96ba-1579e552342e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c323ffc-78f3-418b-96ba-1579e552342e', 'volume_size': 1} Jul 05 19:58:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:27 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.267s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:27 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Deleted volume successfully. Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (274c174c-ffc9-4ba8-8fb1-5af495b3d6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e51ae5-e307-4892-8538-d7a9667c481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e51ae5-e307-4892-8538-d7a9667c481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2143113654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e88d467-d23c-442b-8559-1aa722847e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:27Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df67fe9-8ed8-4b76-b571-31abaf3904f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df67fe9-8ed8-4b76-b571-31abaf3904f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fd8551-bfb1-4052-b63c-0fa9cbc94121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fd8551-bfb1-4052-b63c-0fa9cbc94121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e88d467-d23c-442b-8559-1aa722847e6b', 'volume_name': 'volume-5e88d467-d23c-442b-8559-1aa722847e6b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab1907a-4826-48a7-93bc-3a6977014ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab1907a-4826-48a7-93bc-3a6977014ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fef95d-e346-4971-90f0-c4f7b4b5380a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:27 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume 5e88d467-d23c-442b-8559-1aa722847e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e88d467-d23c-442b-8559-1aa722847e6b', 'volume_size': 1} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-28596afd-a76d-4a9a-bf6b-4dc8106174a9 tempest-CinderUnicodeTest-611605285 None] Lock "cinder-208fc041-dd76-44f2-8a97-2879f66c9cb8-delete_volume" released by "delete_volume" :: held 3.979s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:27 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 1073741824" returned: 0 in 1.481s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:27 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 Jul 05 19:58:27 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:28 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766" returned: 0 in 0.687s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.551s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1885795356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb713ea-bd15-4f88-8063-78fc761995ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:26Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Creating volume 7cb713ea-bd15-4f88-8063-78fc761995ab {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:28 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:28 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab 1073741824 Jul 05 19:58:28 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a382a0-4a94-4d48-9661-ab5233f23b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdb4a54-57a1-45b0-9489-c268b6afb4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:28 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 (08c69a72-69b1-41bf-8ad5-2a3e9940a766): created successfully Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdb4a54-57a1-45b0-9489-c268b6afb4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (67153250-49bb-45be-931b-293a128f3bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-aff43f55-f7b6-4708-ab01-b85d5a6763cf tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created volume successfully. Jul 05 19:58:29 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab 1073741824" returned: 0 in 1.051s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:29 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab Jul 05 19:58:29 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:30 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab" returned: 0 in 0.661s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.038s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276995672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c391822f-0e1c-423d-920d-4499e1d288f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:26Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Creating volume c391822f-0e1c-423d-920d-4499e1d288f7 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:30 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a6af81-4f26-43a4-be1f-e770a0c39426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb713ea-bd15-4f88-8063-78fc761995ab', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:30 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7 1073741824 Jul 05 19:58:30 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a9a5ce-e33e-432a-90ca-0b41e8e092b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:30 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume volume-7cb713ea-bd15-4f88-8063-78fc761995ab (7cb713ea-bd15-4f88-8063-78fc761995ab): created successfully Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a9a5ce-e33e-432a-90ca-0b41e8e092b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (7f2f7a86-5a44-40c6-92a9-6f410beb12e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:30 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-99a3b900-c679-4a4e-804d-3d3b03e6ccef tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created volume successfully. Jul 05 19:58:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6a5c40db-80b2-4a74-a099-32357eb1dacd tempest-ProjectAdminTests-188964265 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86389) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 19:58:31 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7 1073741824" returned: 0 in 0.856s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:31 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7 Jul 05 19:58:31 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:31 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7" returned: 0 in 0.811s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.949s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775716600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c323ffc-78f3-418b-96ba-1579e552342e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:27Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Creating volume 9c323ffc-78f3-418b-96ba-1579e552342e {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:31 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3c6b83-d450-4891-8442-34dea2b69cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c391822f-0e1c-423d-920d-4499e1d288f7', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a4d4e-3bd9-4385-afe2-aa612f31ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:31 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e 1073741824 Jul 05 19:58:31 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:31 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume volume-c391822f-0e1c-423d-920d-4499e1d288f7 (c391822f-0e1c-423d-920d-4499e1d288f7): created successfully Jul 05 19:58:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a4d4e-3bd9-4385-afe2-aa612f31ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:32 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (67282850-7937-4e50-8734-f0724934657e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:32 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2b9ca3cf-c525-4d55-bf47-0b15c8c8e2ca tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created volume successfully. Jul 05 19:58:32 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e 1073741824" returned: 0 in 1.050s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:33 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e Jul 05 19:58:33 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:33 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e" returned: 0 in 0.683s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.052s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2143113654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e88d467-d23c-442b-8559-1aa722847e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d964ef63a7524e2abb9d3fc9003fff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:27Z,use_quota=True,user_id='2da1606082064d25a06b5a4ef8ce87f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Creating volume 5e88d467-d23c-442b-8559-1aa722847e6b {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:33 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0e9890-0e55-4ec8-8b94-0d7d1d29dbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c323ffc-78f3-418b-96ba-1579e552342e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:33 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b 1073741824 Jul 05 19:58:33 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4534b91a-0457-48db-94a6-7d4908d93259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:33 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume volume-9c323ffc-78f3-418b-96ba-1579e552342e (9c323ffc-78f3-418b-96ba-1579e552342e): created successfully Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4534b91a-0457-48db-94a6-7d4908d93259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (9dc09c17-fba3-4529-b6bf-171cddcba625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c8b5ca17-03ad-42ef-8d46-5946e4d048a9 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created volume successfully. Jul 05 19:58:34 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b 1073741824" returned: 0 in 0.948s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:34 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b Jul 05 19:58:34 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:35 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b" returned: 0 in 0.689s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.589s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fef95d-e346-4971-90f0-c4f7b4b5380a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e88d467-d23c-442b-8559-1aa722847e6b', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2832e9a3-c39e-4be5-b697-d59b23bf5c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Creating offline snapshot 05ad242f-eae6-4aff-91e1-8d3887949500 of volume 9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:58:35 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Volume volume-5e88d467-d23c-442b-8559-1aa722847e6b (5e88d467-d23c-442b-8559-1aa722847e6b): created successfully Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2832e9a3-c39e-4be5-b697-d59b23bf5c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Flow 'volume_create_manager' (274c174c-ffc9-4ba8-8fb1-5af495b3d6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43d0cbb-1cf6-4b43-a8bb-0e151ccde13c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e341e233-4786-4df3-8f0c-1760226ad5f6 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created volume successfully. Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (816f45e0-e732-4764-9d68-c829251f0469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2e8b81-144f-4265-9d21-8ad40a4ed3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2e8b81-144f-4265-9d21-8ad40a4ed3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579377585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8853a87c-0873-4ca5-a0fb-7d3cc3df20f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:35Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c007f45e-9f0c-42c2-8b10-d3c5efe6174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c007f45e-9f0c-42c2-8b10-d3c5efe6174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ebb235-e69a-49e6-b2c4-270277789b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ebb235-e69a-49e6-b2c4-270277789b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8853a87c-0873-4ca5-a0fb-7d3cc3df20f6', 'volume_name': 'volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:35 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb Jul 05 19:58:35 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838cf298-66b3-4f8d-989e-17152404b761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838cf298-66b3-4f8d-989e-17152404b761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798bfd8f-21f4-4792-8f68-04f3249466a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:35 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Volume 8853a87c-0873-4ca5-a0fb-7d3cc3df20f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6', 'volume_size': 1} Jul 05 19:58:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-5e88d467-d23c-442b-8559-1aa722847e6b-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-5e88d467-d23c-442b-8559-1aa722847e6b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:36 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" returned: 0 in 0.849s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-quobyte-5e88d467-d23c-442b-8559-1aa722847e6b" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:36 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 1G Jul 05 19:58:36 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-5e88d467-d23c-442b-8559-1aa722847e6b" acquired by "delete_volume" :: waited 0.020s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:36 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f521f81-6573-4fbd-a1df-d786a31995e5]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:36 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b Jul 05 19:58:36 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:37 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b" returned: 0 in 0.809s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:37 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 1G" returned: 0 in 0.892s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:37 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b Jul 05 19:58:37 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:37 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 Jul 05 19:58:37 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:37 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-5e88d467-d23c-442b-8559-1aa722847e6b" returned: 0 in 0.689s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-5e88d467-d23c-442b-8559-1aa722847e6b" released by "delete_volume" :: held 1.549s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:37 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=190,cinder:SELECT=136,cinder:INSERT=51,cinder:DELETE=16 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500" returned: 0 in 0.734s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:37 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 is being set with open permissions: ugo+rw Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:37 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=135,cinder:UPDATE=183,cinder:INSERT=42,cinder:DELETE=21 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:58:37 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 Jul 05 19:58:37 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created reservations ['75c2889b-0265-42f9-81d3-ff2c5fe64fd9', '20c21dcf-8658-41da-9ffa-5d2e91d65c3b', '3d459434-f5ef-4057-9fbd-532c55e973c1', '005342db-fd02-425e-91dc-0b1643f0b026'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:38 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:38 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-9c323ffc-78f3-418b-96ba-1579e552342e-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-9c323ffc-78f3-418b-96ba-1579e552342e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-quobyte-9c323ffc-78f3-418b-96ba-1579e552342e" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-9c323ffc-78f3-418b-96ba-1579e552342e" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e355a7e8-9833-4b4e-bf42-69a05fe3de33]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:38 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500" returned: 0 in 0.836s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:38 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e Jul 05 19:58:38 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:38 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.info Jul 05 19:58:38 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:38 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.817s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:38 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Deleted volume successfully. Jul 05 19:58:38 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-a4aa191a-c255-4d04-be24-984269f3deeb tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-5e88d467-d23c-442b-8559-1aa722847e6b-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:39 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e" returned: 0 in 0.816s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:39 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.info" returned: 0 in 0.696s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:39 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.info is being set with open permissions: ugo+rw Jul 05 19:58:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:39 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e Jul 05 19:58:39 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:39 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.info Jul 05 19:58:39 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:40 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:40 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9c323ffc-78f3-418b-96ba-1579e552342e" returned: 0 in 0.679s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.info" returned: 0 in 0.676s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.817s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-9c323ffc-78f3-418b-96ba-1579e552342e" released by "delete_volume" :: held 1.594s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.626s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579377585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8853a87c-0873-4ca5-a0fb-7d3cc3df20f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:35Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Creating volume 8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:40 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:40 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 1073741824 Jul 05 19:58:40 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:40 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b1d9c03e-cf91-4bb6-ada1-92db15032041 tempest-VolumeDependencyTests-1214949651 None] Create snapshot completed successfully Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created reservations ['d216d3d8-73ee-45a1-9cd4-9172479302d9', '9d8fc11d-6230-4a88-b68f-9763aa73304b', 'd2955678-a8dc-4031-a592-9c5cdab1732c', '8c4c1684-c21e-43d3-b83d-97927fcc63f2'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:40 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:40 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-c391822f-0e1c-423d-920d-4499e1d288f7-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-c391822f-0e1c-423d-920d-4499e1d288f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-quobyte-c391822f-0e1c-423d-920d-4499e1d288f7" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-c391822f-0e1c-423d-920d-4499e1d288f7" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb827695-65af-44c8-8ef5-564aafbf296b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:41 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7 Jul 05 19:58:41 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:41 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.781s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:41 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:41 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Deleted volume successfully. Jul 05 19:58:41 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 1073741824" returned: 0 in 0.993s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-905bc35e-d8a7-4e45-8c44-e4c7633c67ea tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-9c323ffc-78f3-418b-96ba-1579e552342e-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:41 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 Jul 05 19:58:41 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:58:42 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Flow 'volume_create_manager' (41eba275-e9d0-4fe5-8629-f87db300f0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751f8dac-18f4-4146-8377-0a3b3927a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7" returned: 0 in 1.226s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:42 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751f8dac-18f4-4146-8377-0a3b3927a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1133401912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe9936b-9794-4b99-8efb-1e764cc87901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d95f1572db4f79a5a8d2204af61eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05ad242f-eae6-4aff-91e1-8d3887949500,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:58:42Z,use_quota=True,user_id='4aa22ad73b94451890e6a4a797d022a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:42 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7 Jul 05 19:58:42 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9a44c5-5b67-4d02-846f-ef7347fcf587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9a44c5-5b67-4d02-846f-ef7347fcf587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dde0c6-7d27-45e9-8a21-8753212f1be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dde0c6-7d27-45e9-8a21-8753212f1be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3fe9936b-9794-4b99-8efb-1e764cc87901', 'volume_name': 'volume-3fe9936b-9794-4b99-8efb-1e764cc87901', 'volume_size': 1, 'snapshot_id': '05ad242f-eae6-4aff-91e1-8d3887949500'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910d568b-575f-410d-83e4-460fbafc49c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910d568b-575f-410d-83e4-460fbafc49c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e05b4bc-cc52-486e-ba47-89c3dcf2586a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:42 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Volume 3fe9936b-9794-4b99-8efb-1e764cc87901: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3fe9936b-9794-4b99-8efb-1e764cc87901', 'volume_size': 1, 'snapshot_id': '05ad242f-eae6-4aff-91e1-8d3887949500'} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" returned: 0 in 0.975s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "cinder-quobyte-05ad242f-eae6-4aff-91e1-8d3887949500-3fe9936b-9794-4b99-8efb-1e764cc87901" by "_create_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798bfd8f-21f4-4792-8f68-04f3249466a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28081de-9e47-4893-9e44-09ecb7566971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-05ad242f-eae6-4aff-91e1-8d3887949500-3fe9936b-9794-4b99-8efb-1e764cc87901" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Creating volume 3fe9936b-9794-4b99-8efb-1e764cc87901 from snapshot 05ad242f-eae6-4aff-91e1-8d3887949500 {{(pid=86389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "cinder-quobyte-3fe9936b-9794-4b99-8efb-1e764cc87901" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:42 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Volume volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 (8853a87c-0873-4ca5-a0fb-7d3cc3df20f6): created successfully Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28081de-9e47-4893-9e44-09ecb7566971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (816f45e0-e732-4764-9d68-c829251f0469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-3fe9936b-9794-4b99-8efb-1e764cc87901" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] snapshot: 05ad242f-eae6-4aff-91e1-8d3887949500, volume: 3fe9936b-9794-4b99-8efb-1e764cc87901, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:58:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-a3079c78-0654-4c13-ab83-d41e04d76ad1 tempest-ProjectReaderTests-1933739378 None] Created volume successfully. Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff9a8f6-4835-4208-b7e7-31cb0dd27c1f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:42 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 Jul 05 19:58:42 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:42 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c391822f-0e1c-423d-920d-4499e1d288f7" returned: 0 in 0.692s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-c391822f-0e1c-423d-920d-4499e1d288f7" released by "delete_volume" :: held 1.962s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:42 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created reservations ['2b433c11-ebc8-40d6-b100-01644c80c0cd', '6142e1e4-95ac-431c-bb1a-fa5f43decd25', 'f6e8947c-457d-494e-9d44-186bab93c1f9', '1e322530-3422-4e1b-91de-c0d43777722f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:43 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:43 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-7cb713ea-bd15-4f88-8063-78fc761995ab-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-7cb713ea-bd15-4f88-8063-78fc761995ab-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-quobyte-7cb713ea-bd15-4f88-8063-78fc761995ab" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-7cb713ea-bd15-4f88-8063-78fc761995ab" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53cc24e-e4c2-4ff2-809b-d777374296b4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:43 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500" returned: 0 in 1.024s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb5be7a-415a-4858-884b-f1f6ff73bcdb]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:43 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab Jul 05 19:58:43 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:43 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb Jul 05 19:58:43 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:44 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.979s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:44 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Deleted volume successfully. Jul 05 19:58:44 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e4cc9091-4c97-456f-910a-6c514d336fde tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-c391822f-0e1c-423d-920d-4499e1d288f7-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:44 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab" returned: 0 in 0.904s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:44 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab Jul 05 19:58:44 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:44 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" returned: 0 in 0.978s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:44 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:58:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:44 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 Jul 05 19:58:44 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:45 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7cb713ea-bd15-4f88-8063-78fc761995ab" returned: 0 in 0.789s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-7cb713ea-bd15-4f88-8063-78fc761995ab" released by "delete_volume" :: held 1.760s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created reservations ['746f4a02-0db5-4992-af4d-ac3ff5e82bda', '9920c7cd-cf04-4e12-92e0-d69bfd112404', '14ae6c9e-cb20-4778-8561-48a900054b0b', '832414d5-2b50-4423-8ed8-86325f80c1fa'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:45 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:45 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-08c69a72-69b1-41bf-8ad5-2a3e9940a766-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-08c69a72-69b1-41bf-8ad5-2a3e9940a766-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-quobyte-08c69a72-69b1-41bf-8ad5-2a3e9940a766" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-08c69a72-69b1-41bf-8ad5-2a3e9940a766" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b164be-5c43-4bff-a749-0a90f98e45d6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:46 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 Jul 05 19:58:46 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:46 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.433s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:46 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Deleted volume successfully. Jul 05 19:58:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-5cd16bb3-072c-4edc-bddc-020b9e74928f tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-7cb713ea-bd15-4f88-8063-78fc761995ab-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:47 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766" returned: 0 in 1.454s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:47 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766 Jul 05 19:58:47 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:48 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-08c69a72-69b1-41bf-8ad5-2a3e9940a766" returned: 0 in 1.547s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-08c69a72-69b1-41bf-8ad5-2a3e9940a766" released by "delete_volume" :: held 3.122s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created reservations ['325a897f-da18-48af-ab00-0ca0e396ffca', '0f0d1439-d28d-44f2-ba6f-f24528f717ed', 'edfc1f51-6fbf-46bf-ac71-5b6d52c5829e', '117b4f28-cc8e-4d66-b7ef-21601e9f36c0'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:49 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:49 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-438845f8-0764-458f-8b06-a5a5c377114d-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-438845f8-0764-458f-8b06-a5a5c377114d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-quobyte-bc3b10b3-baed-4834-be30-83f7bd718fe3" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-bc3b10b3-baed-4834-be30-83f7bd718fe3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-quobyte-438845f8-0764-458f-8b06-a5a5c377114d" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-438845f8-0764-458f-8b06-a5a5c377114d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Deleting offline snapshot 438845f8-0764-458f-8b06-a5a5c377114d of volume bc3b10b3-baed-4834-be30-83f7bd718fe3 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] snapshot_file for this snap is: volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7937f63c-08c6-44cd-a3a9-875ae6461ba3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:50 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d Jul 05 19:58:50 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:50 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.408s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:50 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:50 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Deleted volume successfully. Jul 05 19:58:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-33fff505-2aef-46d0-96d4-2b74845e61c0 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-08c69a72-69b1-41bf-8ad5-2a3e9940a766-delete_volume" released by "delete_volume" :: held 4.981s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:50 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901" returned: 0 in 6.288s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:50 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bfdb0b-ad22-4836-ac82-19f5caeee0fc]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:50 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb Jul 05 19:58:50 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:51 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d" returned: 0 in 1.503s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc3b10b3-baed-4834-be30-83f7bd718fe3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:58:51 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[96188733-6493-401b-8f66-d79fbaa7a99b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:51 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 Jul 05 19:58:51 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:51 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" returned: 0 in 1.029s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:51 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:58:51 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Converted 1024.00 MB image at 162.81 MB/s Jul 05 19:58:51 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 is being set with open permissions: ugo+rw Jul 05 19:58:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:51 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 Jul 05 19:58:51 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:52 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3" returned: 0 in 0.827s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:52 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d Jul 05 19:58:52 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:52 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901" returned: 0 in 0.880s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-3fe9936b-9794-4b99-8efb-1e764cc87901" released by "_copy_volume_from_snapshot" :: held 10.336s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-05ad242f-eae6-4aff-91e1-8d3887949500-3fe9936b-9794-4b99-8efb-1e764cc87901" released by "_create_volume_from_snapshot" :: held 10.399s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.432s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.211s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Creating offline snapshot 9f02a81f-0991-4047-bd84-ebed4dcee15b of volume 8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e05b4bc-cc52-486e-ba47-89c3dcf2586a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe9936b-9794-4b99-8efb-1e764cc87901', 'volume_size': 1, 'snapshot_id': '05ad242f-eae6-4aff-91e1-8d3887949500'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6f5824-f36d-431e-a899-3d7f0bcd9b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0cfd68-838b-446a-b89a-85acea01edc7]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:52 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Volume volume-3fe9936b-9794-4b99-8efb-1e764cc87901 (3fe9936b-9794-4b99-8efb-1e764cc87901): created successfully Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6f5824-f36d-431e-a899-3d7f0bcd9b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:58:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Flow 'volume_create_manager' (41eba275-e9d0-4fe5-8629-f87db300f0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:58:52 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c88f2f14-8dcc-4295-8bf5-4ef4cbd115f2 tempest-VolumeDependencyTests-1214949651 None] Created volume successfully. Jul 05 19:58:52 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 Jul 05 19:58:52 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:53 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d" returned: 0 in 1.044s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:53 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d Jul 05 19:58:53 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "cinder-05ad242f-eae6-4aff-91e1-8d3887949500-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-05ad242f-eae6-4aff-91e1-8d3887949500-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "cinder-quobyte-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "cinder-quobyte-05ad242f-eae6-4aff-91e1-8d3887949500" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-05ad242f-eae6-4aff-91e1-8d3887949500" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Deleting offline snapshot 05ad242f-eae6-4aff-91e1-8d3887949500 of volume 9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] snapshot_file for this snap is: volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f89cb63-1427-42e2-8516-1a84abb1adab]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:53 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 Jul 05 19:58:53 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:53 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" returned: 0 in 1.056s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:53 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b 1G Jul 05 19:58:53 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:53 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3.438845f8-0764-458f-8b06-a5a5c377114d" returned: 0 in 0.862s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-438845f8-0764-458f-8b06-a5a5c377114d" released by "_delete_snapshot" :: held 4.452s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-bc3b10b3-baed-4834-be30-83f7bd718fe3" released by "delete_snapshot" :: held 4.496s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created reservations ['7cfcfb18-2fb3-46cb-8b08-385a08991732', 'd5a4f4c5-65c2-47c3-89be-3caa468d3eb8', 'fdfd6281-77fe-4689-b03d-1d2ff1779066', '3f368ef4-269d-44a1-a55c-a29f70d522a4'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:54 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Delete snapshot completed successfully. Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7f943b78-3bcf-4f7d-97a9-71b1446e59d1 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-438845f8-0764-458f-8b06-a5a5c377114d-delete_snapshot" released by "delete_snapshot" :: held 4.680s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:54 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500" returned: 0 in 0.960s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a1901-c3fd-415b-901e-25e04104986a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:54 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb Jul 05 19:58:54 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:54 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b 1G" returned: 0 in 0.951s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:54 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b Jul 05 19:58:54 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-bc3b10b3-baed-4834-be30-83f7bd718fe3-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-bc3b10b3-baed-4834-be30-83f7bd718fe3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "cinder-quobyte-bc3b10b3-baed-4834-be30-83f7bd718fe3" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-bc3b10b3-baed-4834-be30-83f7bd718fe3" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:55 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbeeeab-d554-4601-aaf0-60efa5d1e827]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:55 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" returned: 0 in 0.940s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:55 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 Jul 05 19:58:55 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:55 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 Jul 05 19:58:55 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:55 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b" returned: 0 in 1.032s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:55 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b is being set with open permissions: ugo+rw Jul 05 19:58:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:55 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b Jul 05 19:58:55 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:56 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3" returned: 0 in 0.969s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:56 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3 Jul 05 19:58:56 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:56 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500" returned: 0 in 0.940s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:56 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500 Jul 05 19:58:56 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:56 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b" returned: 0 in 0.804s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:56 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.info Jul 05 19:58:56 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:56 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-bc3b10b3-baed-4834-be30-83f7bd718fe3" returned: 0 in 0.829s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-quobyte-bc3b10b3-baed-4834-be30-83f7bd718fe3" released by "delete_volume" :: held 1.869s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:56 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb.05ad242f-eae6-4aff-91e1-8d3887949500" returned: 0 in 0.821s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:56 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Created reservations ['21356724-d31b-468c-b8c8-3665d7b4f632', '1e4882a8-bef2-402b-b882-bca4c870bc9b', 'd8516f00-8eeb-4b5e-9a9e-a99307d7f95d', 'a9494f49-3945-4375-8951-9a41f16e69a4'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-05ad242f-eae6-4aff-91e1-8d3887949500" released by "_delete_snapshot" :: held 3.807s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" released by "delete_snapshot" :: held 3.847s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Created reservations ['481be152-fcf9-4d39-8093-bd9dd7b2dfc4', '57cbaa3e-685b-4248-8bfb-52397becba2b', '002541b3-a89f-436a-b1fd-25641de6f5aa', 'c5a9ddc8-ee1f-4a43-81af-e874c9c51e01'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:58:57 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:58:57 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:57 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Delete snapshot completed successfully. Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-68f27b96-67c1-41c1-bf1e-faeacea1cfe4 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-05ad242f-eae6-4aff-91e1-8d3887949500-delete_snapshot" released by "delete_snapshot" :: held 4.097s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "cinder-9351e7d9-6f07-4f47-9572-1d7c2dd492bb-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:57 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.info" returned: 0 in 0.918s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:57 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.info is being set with open permissions: ugo+rw Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-9351e7d9-6f07-4f47-9572-1d7c2dd492bb-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:57 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.info Jul 05 19:58:57 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "cinder-quobyte-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a4d637-7f27-4535-9641-87ac5ebdb094]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:58 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb Jul 05 19:58:58 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:58 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.162s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:58 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:58:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Deleted volume successfully. Jul 05 19:58:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-40b22a93-dac1-49cf-85f1-60f9a4b39ae8 tempest-CreateVolumesFromSnapshotTest-1765694002 None] Lock "cinder-bc3b10b3-baed-4834-be30-83f7bd718fe3-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:58 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.info" returned: 0 in 0.989s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.899s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:58:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-16b63fc3-9556-4305-9eff-daa7c084549a tempest-ProjectReaderTests-1933739378 None] Create snapshot completed successfully Jul 05 19:58:58 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" returned: 0 in 1.174s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:59 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb Jul 05 19:58:59 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-9f02a81f-0991-4047-bd84-ebed4dcee15b-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-9f02a81f-0991-4047-bd84-ebed4dcee15b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-9f02a81f-0991-4047-bd84-ebed4dcee15b" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-9f02a81f-0991-4047-bd84-ebed4dcee15b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Deleting offline snapshot 9f02a81f-0991-4047-bd84-ebed4dcee15b of volume 8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:58:59 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] snapshot_file for this snap is: volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" returned: 0 in 0.922s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb8f34d-e431-47c0-9dc3-6ccdb906ce5b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-9351e7d9-6f07-4f47-9572-1d7c2dd492bb" released by "delete_volume" :: held 2.226s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:58:59 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Created reservations ['57335457-ecc9-4457-9fa7-c45cdb89fdda', '0b91377d-837f-4ec9-a048-56255dd62888', '75c90886-7ff8-4231-bedc-e649b6e01677', '7a78fc43-39f7-4b8c-96eb-8467fb08204f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:00 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b Jul 05 19:59:00 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:00 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:00 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:00 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.737s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:59:00 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Deleted volume successfully. Jul 05 19:59:00 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b" returned: 0 in 0.954s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-bc92f632-b95f-4843-9d57-2726b2614579 tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-9351e7d9-6f07-4f47-9572-1d7c2dd492bb-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d59dee7-60b0-48c3-bca8-f716e15e017f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "cinder-3fe9936b-9794-4b99-8efb-1e764cc87901-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-3fe9936b-9794-4b99-8efb-1e764cc87901-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "cinder-quobyte-3fe9936b-9794-4b99-8efb-1e764cc87901" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:01 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 Jul 05 19:59:01 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-3fe9936b-9794-4b99-8efb-1e764cc87901" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:01 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa3b2d9-79ad-4244-8f64-32e0273df574]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:01 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 Jul 05 19:59:01 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:02 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" returned: 0 in 1.065s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:02 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b Jul 05 19:59:02 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:02 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901" returned: 0 in 0.982s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:02 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901 Jul 05 19:59:02 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:02 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b" returned: 0 in 0.898s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:02 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b Jul 05 19:59:02 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:02 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3fe9936b-9794-4b99-8efb-1e764cc87901" returned: 0 in 0.795s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-quobyte-3fe9936b-9794-4b99-8efb-1e764cc87901" released by "delete_volume" :: held 1.841s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Created reservations ['c28305f5-19ef-48b3-8c19-650a774cb626', '11d7bc99-74c9-4dee-96e3-5b493a164d54', '983d2a37-35db-4016-9dd1-d7ccaf761db5', '12c99bf6-ea1c-4ab2-aaab-5f046276b957'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:03 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:03 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:03 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6.9f02a81f-0991-4047-bd84-ebed4dcee15b" returned: 0 in 0.998s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-9f02a81f-0991-4047-bd84-ebed4dcee15b" released by "_delete_snapshot" :: held 4.086s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" released by "delete_snapshot" :: held 4.127s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Created reservations ['4377f785-d98a-45d2-a496-4ec1d098ec56', '38c481e6-d0e2-45a9-b43a-0b8c144c6759', '627952ce-4f90-4f18-afa1-f75fcc663d47', '12e37535-a1c9-4795-ac94-b89e64315b6e'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:04 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Delete snapshot completed successfully. Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-525fa341-536d-46bb-b166-9c9f00fd88a6 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-9f02a81f-0991-4047-bd84-ebed4dcee15b-delete_snapshot" released by "delete_snapshot" :: held 4.338s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:04 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 1.069s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:59:04 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Deleted volume successfully. Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2f79f01d-3141-4026-9f56-83129793d92a tempest-VolumeDependencyTests-1214949651 None] Lock "cinder-3fe9936b-9794-4b99-8efb-1e764cc87901-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Flow 'volume_create_manager' (a686cbf6-2567-4dd6-b2e7-a355a2996a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6026c94-5408-42f2-bf6b-bf4e5b4596b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6026c94-5408-42f2-bf6b-bf4e5b4596b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1959aa-c9ac-434d-a4da-ff35bb768820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974270fd6f944914aa075ec75af3b349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:05Z,use_quota=True,user_id='4ce12e79be5a4d5b9916369df5628e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74d8aa5-17a9-4050-8cbe-c8711b9d5fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74d8aa5-17a9-4050-8cbe-c8711b9d5fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b4a6b4-e2dd-4c7c-b242-fd71fff4921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:04 devstack cinder-volume[86389]: DEBUG cinder.image.glance [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Creating Keystone auth plugin from conf {{(pid=86389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b4a6b4-e2dd-4c7c-b242-fd71fff4921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a1959aa-c9ac-434d-a4da-ff35bb768820', 'volume_name': 'volume-4a1959aa-c9ac-434d-a4da-ff35bb768820', 'volume_size': 1, 'image_id': '6564aec4-d578-471e-91d1-66baa0e13547', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6564aec4-d578-471e-91d1-66baa0e13547', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a94231d052a1875d91e5c06a4f9d7b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '974270fd6f944914aa075ec75af3b349', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96582f412bb5635a297b2d2fa45ee56055ab653d43da8ea263d509f50bb7e62da6428954901bf446e7a62b636432f11778773add5a67a144e4b161a6b3ac7207', 'id': '6564aec4-d578-471e-91d1-66baa0e13547', 'created_at': datetime.datetime(2026, 7, 5, 17, 59, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 59, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6564aec4-d578-471e-91d1-66baa0e13547/file', 'properties': {}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7630d6-abb3-4956-a36e-540fc89f8434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7630d6-abb3-4956-a36e-540fc89f8434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a27e21-5c91-444d-a226-fe8d53c49867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:05 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Volume 4a1959aa-c9ac-434d-a4da-ff35bb768820: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a1959aa-c9ac-434d-a4da-ff35bb768820', 'volume_size': 1, 'image_id': '6564aec4-d578-471e-91d1-66baa0e13547', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6564aec4-d578-471e-91d1-66baa0e13547', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a94231d052a1875d91e5c06a4f9d7b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '974270fd6f944914aa075ec75af3b349', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96582f412bb5635a297b2d2fa45ee56055ab653d43da8ea263d509f50bb7e62da6428954901bf446e7a62b636432f11778773add5a67a144e4b161a6b3ac7207', 'id': '6564aec4-d578-471e-91d1-66baa0e13547', 'created_at': datetime.datetime(2026, 7, 5, 17, 59, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 59, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6564aec4-d578-471e-91d1-66baa0e13547/file', 'properties': {}}, 'image_service': } Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Trying to clone 4a1959aa-c9ac-434d-a4da-ff35bb768820 from image 6564aec4-d578-471e-91d1-66baa0e13547 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6564aec4-d578-471e-91d1-66baa0e13547', 'metadata': {}}]). {{(pid=86389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 19:59:05 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Image download 0.00 MB at 0.00 MB/s Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Lock "cinder-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0bfde9-ac83-4052-9982-5e3d21b85fc9]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" acquired by "delete_volume" :: waited 0.040s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d58af3-4bd7-4e76-b099-c9f3843dd851]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:05 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD Jul 05 19:59:05 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:05 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 Jul 05 19:59:05 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:06 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD" returned: 0 in 0.894s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:06 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" returned: 0 in 0.894s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:06 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6 Jul 05 19:59:06 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:06 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD Jul 05 19:59:06 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:07 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD" returned: 1 in 0.972s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Temporary image 6564aec4-d578-471e-91d1-66baa0e13547 is fetched for user 4ce12e79be5a4d5b9916369df5628e59. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5006a941-e6b4-4781-8437-107326763984]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:07 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" returned: 0 in 1.092s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6" released by "delete_volume" :: held 2.087s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:07 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD Jul 05 19:59:07 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Created reservations ['18303a31-97d2-44e7-881f-e79b0ca00ba6', 'cca4e43c-6449-43e7-8a6a-57dcfc7317db', 'ab8589ee-b1cb-47d7-91b4-74ec7084c488', '9e78b216-78ff-4963-bdc0-2bbbd4005432'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:07 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:07 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:08 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD" returned: 0 in 1.042s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:08 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.847s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:08 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:59:08 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Deleted volume successfully. Jul 05 19:59:08 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD Jul 05 19:59:08 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-628fa678-e6bb-47b7-994e-697fb689784f tempest-ProjectReaderTests-1933739378 None] Lock "cinder-8853a87c-0873-4ca5-a0fb-7d3cc3df20f6-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:09 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD" returned: 1 in 0.863s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1959aa-c9ac-434d-a4da-ff35bb768820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974270fd6f944914aa075ec75af3b349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:05Z,use_quota=True,user_id='4ce12e79be5a4d5b9916369df5628e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Creating volume 4a1959aa-c9ac-434d-a4da-ff35bb768820 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:59:09 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:09 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 1073741824 Jul 05 19:59:09 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (93d9bb25-e7a0-4983-b3c8-4638b866f449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94a1d4e-d357-483a-9d28-29fa0e46e045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94a1d4e-d357-483a-9d28-29fa0e46e045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171249861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd76806e-7c9c-4072-a28b-746622f90c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:10Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42fc5752-246c-470b-b1f6-f08267584220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42fc5752-246c-470b-b1f6-f08267584220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812d70f2-2051-4d6c-8a8a-e0d93ed1e300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812d70f2-2051-4d6c-8a8a-e0d93ed1e300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd76806e-7c9c-4072-a28b-746622f90c05', 'volume_name': 'volume-fd76806e-7c9c-4072-a28b-746622f90c05', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6457c21-27da-469a-b9f5-ebb5b81c2a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6457c21-27da-469a-b9f5-ebb5b81c2a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dbd9d6-6981-40e0-a8ee-4331cc44d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:09 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Volume fd76806e-7c9c-4072-a28b-746622f90c05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd76806e-7c9c-4072-a28b-746622f90c05', 'volume_size': 1} Jul 05 19:59:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:10 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 1073741824" returned: 0 in 1.254s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:10 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 Jul 05 19:59:10 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:11 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820" returned: 0 in 0.739s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.066s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171249861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd76806e-7c9c-4072-a28b-746622f90c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:10Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Creating volume fd76806e-7c9c-4072-a28b-746622f90c05 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:59:11 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:11 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 1073741824 Jul 05 19:59:11 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Attempting download of 6564aec4-d578-471e-91d1-66baa0e13547 ((None, [{'url': 'file:///opt/stack/data/glance/images/6564aec4-d578-471e-91d1-66baa0e13547', 'metadata': {}}])) to volume 4a1959aa-c9ac-434d-a4da-ff35bb768820. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31053e1-d547-41e0-b5b1-120bb53d4945]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6564aec4-d578-471e-91d1-66baa0e13547_fmudhyz2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:11 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6564aec4-d578-471e-91d1-66baa0e13547_fmudhyz2 Jul 05 19:59:11 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:12 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6564aec4-d578-471e-91d1-66baa0e13547_fmudhyz2" returned: 0 in 1.079s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6564aec4-d578-471e-91d1-66baa0e13547_fmudhyz2 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:12 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 1073741824" returned: 0 in 1.345s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:12 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6564aec4-d578-471e-91d1-66baa0e13547_fmudhyz2 Jul 05 19:59:12 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:12 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 Jul 05 19:59:12 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:13 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05" returned: 0 in 0.839s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dbd9d6-6981-40e0-a8ee-4331cc44d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd76806e-7c9c-4072-a28b-746622f90c05', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3538e353-fc94-4d08-8a51-e45b1ed5f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:13 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Volume volume-fd76806e-7c9c-4072-a28b-746622f90c05 (fd76806e-7c9c-4072-a28b-746622f90c05): created successfully Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3538e353-fc94-4d08-8a51-e45b1ed5f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (93d9bb25-e7a0-4983-b3c8-4638b866f449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:13 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-57b0ff5d-0043-40c1-a964-88a8466e2d29 tempest-ProjectReaderTests-1933739378 None] Created volume successfully. Jul 05 19:59:13 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6564aec4-d578-471e-91d1-66baa0e13547_fmudhyz2" returned: 1 in 1.339s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6564aec4-d578-471e-91d1-66baa0e13547_fmudhyz2' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc56dfa-f153-4c59-ac78-3957f30d2b92]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:14 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD Jul 05 19:59:14 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Creating offline snapshot 5565a1e4-c28e-4100-8b22-f2cf336b2acf of volume fd76806e-7c9c-4072-a28b-746622f90c05 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[835f3144-8bd0-47f8-8e6a-ac849646a40e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:14 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 Jul 05 19:59:14 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Flow 'volume_create_manager' (4507689d-e310-4632-bbc6-05118ef38f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a252316b-154c-4805-8f7f-2a576cf38101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a252316b-154c-4805-8f7f-2a576cf38101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-171380486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0693a15a-817c-4fc5-a540-999b4a6f622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe8e1e0ab214935ba2c6d98b7e92407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:14Z,use_quota=True,user_id='d732febf912d49ecb009fedf5c127255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef5d12c-aaac-4d9e-9a90-b3c88b4b757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef5d12c-aaac-4d9e-9a90-b3c88b4b757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d79002-f540-4d63-90df-ca507270d28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d79002-f540-4d63-90df-ca507270d28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0693a15a-817c-4fc5-a540-999b4a6f622d', 'volume_name': 'volume-0693a15a-817c-4fc5-a540-999b4a6f622d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473662d4-297f-41c4-a50c-0f373767fb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473662d4-297f-41c4-a50c-0f373767fb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77052b04-d5dc-4825-bd51-170471d7e6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:14 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Volume 0693a15a-817c-4fc5-a540-999b4a6f622d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0693a15a-817c-4fc5-a540-999b4a6f622d', 'volume_size': 1} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:14 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD" returned: 0 in 0.929s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:15 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD Jul 05 19:59:15 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:15 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05" returned: 0 in 0.899s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:59:15 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf 1G Jul 05 19:59:15 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (c0cca710-e58b-4ec6-b834-5a991566e7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c385f37d-f447-46b3-9a93-3d03379502e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c385f37d-f447-46b3-9a93-3d03379502e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-768001166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:15Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5899b650-15ba-42ab-be64-deb6286753e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5899b650-15ba-42ab-be64-deb6286753e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718400a5-7be9-4e79-bd40-548a7faa256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718400a5-7be9-4e79-bd40-548a7faa256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e', 'volume_name': 'volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc15141-01b7-4524-b896-5dd05916eb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc15141-01b7-4524-b896-5dd05916eb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16b2f05-a514-49aa-ac4a-d53a798fe9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:15 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Volume 8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e', 'volume_size': 1} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:15 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD" returned: 1 in 0.819s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] 6564aec4-d578-471e-91d1-66baa0e13547 was raw, converting to raw {{(pid=86389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:15 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 Jul 05 19:59:15 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:15 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf 1G" returned: 0 in 0.809s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd76806e-7c9c-4072-a28b-746622f90c05 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:15 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd76806e-7c9c-4072-a28b-746622f90c05 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf Jul 05 19:59:15 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:16 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:16 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:16 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820" returned: 0 in 0.765s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6564aec4-d578-471e-91d1-66baa0e13547_x3uxy8l1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:59:16 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:16 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 1G Jul 05 19:59:16 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:16 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd76806e-7c9c-4072-a28b-746622f90c05 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf" returned: 0 in 0.713s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:16 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf is being set with open permissions: ugo+rw Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:16 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf Jul 05 19:59:16 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:16 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.714s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 19:59:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 19:59:17 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 1G" returned: 0 in 0.735s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:17 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98beb04-b313-4ab8-9948-35a965070e8a]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:17 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf" returned: 0 in 0.668s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:17 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 Jul 05 19:59:17 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:17 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.info Jul 05 19:59:17 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:18 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.info" returned: 0 in 0.648s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:18 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.info is being set with open permissions: ugo+rw Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:18 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820" returned: 0 in 0.756s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:18 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.info Jul 05 19:59:18 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:18 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 Jul 05 19:59:18 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:18 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.info" returned: 0 in 0.648s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.486s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.119s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-171380486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0693a15a-817c-4fc5-a540-999b4a6f622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe8e1e0ab214935ba2c6d98b7e92407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:14Z,use_quota=True,user_id='d732febf912d49ecb009fedf5c127255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Creating volume 0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:59:18 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:18 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d 1073741824 Jul 05 19:59:18 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:18 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4e1da624-91cb-4eff-b8a3-579baf515374 tempest-ProjectReaderTests-1933739378 None] Create snapshot completed successfully Jul 05 19:59:18 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820" returned: 1 in 0.772s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Downloaded image 6564aec4-d578-471e-91d1-66baa0e13547 ((None, [{'url': 'file:///opt/stack/data/glance/images/6564aec4-d578-471e-91d1-66baa0e13547', 'metadata': {}}])) to volume 4a1959aa-c9ac-434d-a4da-ff35bb768820 successfully. {{(pid=86389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Temporary image 6564aec4-d578-471e-91d1-66baa0e13547 for user 4ce12e79be5a4d5b9916369df5628e59 is deleted. {{(pid=86389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.volume_utils [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Marking volume 4a1959aa-c9ac-434d-a4da-ff35bb768820 as bootable. {{(pid=86389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Copying metadata from image 6564aec4-d578-471e-91d1-66baa0e13547 to 4a1959aa-c9ac-434d-a4da-ff35bb768820. {{(pid=86389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Creating volume glance metadata for volume 4a1959aa-c9ac-434d-a4da-ff35bb768820 backed by image 6564aec4-d578-471e-91d1-66baa0e13547 with: {'image_id': '6564aec4-d578-471e-91d1-66baa0e13547', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0a94231d052a1875d91e5c06a4f9d7b3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a27e21-5c91-444d-a226-fe8d53c49867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1959aa-c9ac-434d-a4da-ff35bb768820', 'volume_size': 1, 'image_id': '6564aec4-d578-471e-91d1-66baa0e13547', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6564aec4-d578-471e-91d1-66baa0e13547', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a94231d052a1875d91e5c06a4f9d7b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '974270fd6f944914aa075ec75af3b349', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96582f412bb5635a297b2d2fa45ee56055ab653d43da8ea263d509f50bb7e62da6428954901bf446e7a62b636432f11778773add5a67a144e4b161a6b3ac7207', 'id': '6564aec4-d578-471e-91d1-66baa0e13547', 'created_at': datetime.datetime(2026, 7, 5, 17, 59, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 17, 59, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6564aec4-d578-471e-91d1-66baa0e13547/file', 'properties': {}}, 'image_service': }' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e471ad-8eb1-48a9-9a3b-1834bab9ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:18 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Volume volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 (4a1959aa-c9ac-434d-a4da-ff35bb768820): created successfully Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e471ad-8eb1-48a9-9a3b-1834bab9ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:18 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Flow 'volume_create_manager' (a686cbf6-2567-4dd6-b2e7-a355a2996a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:18 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-039bd9b3-1318-436c-83c8-b905fbee17e8 tempest-VolumeImageDependencyTests-904790743 None] Created volume successfully. Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Acquiring lock "cinder-4a1959aa-c9ac-434d-a4da-ff35bb768820-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-5565a1e4-c28e-4100-8b22-f2cf336b2acf-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Lock "cinder-4a1959aa-c9ac-434d-a4da-ff35bb768820-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-5565a1e4-c28e-4100-8b22-f2cf336b2acf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-fd76806e-7c9c-4072-a28b-746622f90c05" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-fd76806e-7c9c-4072-a28b-746622f90c05" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-5565a1e4-c28e-4100-8b22-f2cf336b2acf" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Acquiring lock "cinder-quobyte-4a1959aa-c9ac-434d-a4da-ff35bb768820" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-5565a1e4-c28e-4100-8b22-f2cf336b2acf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Deleting offline snapshot 5565a1e4-c28e-4100-8b22-f2cf336b2acf of volume fd76806e-7c9c-4072-a28b-746622f90c05 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] snapshot_file for this snap is: volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Lock "cinder-quobyte-4a1959aa-c9ac-434d-a4da-ff35bb768820" acquired by "delete_volume" :: waited 0.045s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8698f114-8502-4549-89ed-4cab3f5d16ca]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba6b94d-55da-4e79-a995-bd5e7e23a8ae]: (4, 'raw') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:19 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:19 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf Jul 05 19:59:19 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d 1073741824" returned: 0 in 0.979s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:19 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 Jul 05 19:59:19 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:19 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d Jul 05 19:59:19 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:20 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf" returned: 0 in 0.769s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd76806e-7c9c-4072-a28b-746622f90c05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[483fc2ec-cbb7-4505-9410-6f8e87666c60]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:20 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:20 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d" returned: 0 in 0.677s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.126s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-768001166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:15Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Creating volume 8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:59:20 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820" returned: 0 in 0.835s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:20 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e 1073741824 Jul 05 19:59:20 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77052b04-d5dc-4825-bd51-170471d7e6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0693a15a-817c-4fc5-a540-999b4a6f622d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77bfac7-7a1d-4731-97b5-aef3bd45bc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:20 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Volume volume-0693a15a-817c-4fc5-a540-999b4a6f622d (0693a15a-817c-4fc5-a540-999b4a6f622d): created successfully Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77bfac7-7a1d-4731-97b5-aef3bd45bc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Flow 'volume_create_manager' (4507689d-e310-4632-bbc6-05118ef38f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-40bb5796-4b0d-49d3-8db0-df5f1432f52d tempest-SnapshotDependencyTests-1461749044 None] Created volume successfully. Jul 05 19:59:20 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 Jul 05 19:59:20 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:20 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 Jul 05 19:59:20 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:21 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05" returned: 0 in 0.887s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:21 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820" returned: 1 in 0.845s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820' failed. Not Retrying. {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 19:59:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:21 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf Jul 05 19:59:21 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:21 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820 Jul 05 19:59:21 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:21 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e 1073741824" returned: 0 in 0.928s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:21 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e Jul 05 19:59:21 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:21 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-4a1959aa-c9ac-434d-a4da-ff35bb768820" returned: 0 in 0.708s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Lock "cinder-quobyte-4a1959aa-c9ac-434d-a4da-ff35bb768820" released by "delete_volume" :: held 2.457s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:22 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf" returned: 0 in 0.772s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:22 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf Jul 05 19:59:22 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Created reservations ['b4d51515-06c0-4a19-9f80-936f969da6ee', 'b09a8cb9-2b80-48e0-84e9-dd2e51c4d37f', 'c1c6c3df-f17a-41e3-a2d3-cea21a4e37af', 'c49400fb-c6b5-4c7d-bdd6-879b9b5c7787'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:22 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" returned: 0 in 0.720s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Creating offline snapshot d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 of volume 0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16b2f05-a514-49aa-ac4a-d53a798fe9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80a040c-dd81-4859-a931-38f3bc0da9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d0f90c-9e22-4a86-976e-efb13c572686]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:22 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Volume volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e (8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e): created successfully Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80a040c-dd81-4859-a931-38f3bc0da9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (c0cca710-e58b-4ec6-b834-5a991566e7b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:22 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-38bf1700-6812-4b4c-9018-68e5271fad3d tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:22 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:22 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:22 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d Jul 05 19:59:22 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:22 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05.5565a1e4-c28e-4100-8b22-f2cf336b2acf" returned: 0 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-5565a1e4-c28e-4100-8b22-f2cf336b2acf" released by "_delete_snapshot" :: held 3.321s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-fd76806e-7c9c-4072-a28b-746622f90c05" released by "delete_snapshot" :: held 3.354s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:22 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Created reservations ['2d61b9c8-2342-4acc-b95b-a8342b151d3b', '91cba858-8650-42c1-b616-ffa6e2cfeaa6', '0ada74dd-6acc-494e-a11e-fa3e663913d8', 'a7477ac1-bcd7-47df-9d03-a54751eaf929'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Delete snapshot completed successfully. Jul 05 19:59:23 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-13e3ea0f-519b-4c14-a997-020d096d0a64 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-5565a1e4-c28e-4100-8b22-f2cf336b2acf-delete_snapshot" released by "delete_snapshot" :: held 3.631s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.855s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:59:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Deleted volume successfully. Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-6860ab00-b3a2-4267-859a-b6ee75b2fb6e tempest-VolumeImageDependencyTests-904790743 None] Lock "cinder-4a1959aa-c9ac-434d-a4da-ff35bb768820-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:23 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d" returned: 0 in 1.004s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:23 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 1G Jul 05 19:59:23 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-fd76806e-7c9c-4072-a28b-746622f90c05-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-fd76806e-7c9c-4072-a28b-746622f90c05-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-fd76806e-7c9c-4072-a28b-746622f90c05" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-fd76806e-7c9c-4072-a28b-746622f90c05" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[34729a77-4947-454b-b293-8be5a4eeea14]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:23 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 Jul 05 19:59:23 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:24 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 1G" returned: 0 in 0.904s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0693a15a-817c-4fc5-a540-999b4a6f622d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:24 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0693a15a-817c-4fc5-a540-999b4a6f622d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 Jul 05 19:59:24 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:24 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05" returned: 0 in 0.819s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:24 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05 Jul 05 19:59:24 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:24 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0693a15a-817c-4fc5-a540-999b4a6f622d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9" returned: 0 in 0.821s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:24 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 is being set with open permissions: ugo+rw Jul 05 19:59:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:24 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 Jul 05 19:59:24 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:25 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fd76806e-7c9c-4072-a28b-746622f90c05" returned: 0 in 0.671s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-fd76806e-7c9c-4072-a28b-746622f90c05" released by "delete_volume" :: held 1.577s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Created reservations ['b77b1de9-f6db-4189-9973-634323fb461f', 'f7044ff7-0473-431c-bf69-8153f77b2bb0', '4a884ccb-e102-41ce-94c1-d1c7626ad84e', '0fa1c141-15f4-4830-adac-dbb723d0c5de'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:25 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:25 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:25 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9" returned: 0 in 0.712s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:25 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.info Jul 05 19:59:25 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:26 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.688s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:59:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Deleted volume successfully. Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ebc72eec-8f80-4bcc-b2dc-a58c9bd26a06 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-fd76806e-7c9c-4072-a28b-746622f90c05-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:26 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.info" returned: 0 in 0.773s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:26 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.info is being set with open permissions: ugo+rw Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:26 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.info Jul 05 19:59:26 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (78bbfc3a-9e39-4abf-8e16-7f63ac8dabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d75320-9b25-4dad-b5a2-e6204de559c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d75320-9b25-4dad-b5a2-e6204de559c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1974856151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2bff11-48b5-41a2-ac92-94c9772e47ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:27Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd15af5-b947-474d-9573-e5b737008d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd15af5-b947-474d-9573-e5b737008d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c8e429-f9d4-40b9-93ff-48890f8fb907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c8e429-f9d4-40b9-93ff-48890f8fb907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2bff11-48b5-41a2-ac92-94c9772e47ff', 'volume_name': 'volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9384c4ca-d984-422b-8e53-08f6be11ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9384c4ca-d984-422b-8e53-08f6be11ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f5712e-52ef-452a-98e6-d18520b3cd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:26 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Volume fc2bff11-48b5-41a2-ac92-94c9772e47ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff', 'volume_size': 1} Jul 05 19:59:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:27 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.info" returned: 0 in 0.709s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.025s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.027s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Creating offline snapshot eba4acef-d9fa-4754-8da8-59830722fe96 of volume 8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:59:27 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ac6ead5d-061d-4ca2-858f-fd0bdbd52540 tempest-SnapshotDependencyTests-1461749044 None] Create snapshot completed successfully Jul 05 19:59:27 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe22e52-c977-4ba2-baf4-171df926988e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:27 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e Jul 05 19:59:27 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:59:28 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" returned: 0 in 0.863s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:28 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 1G Jul 05 19:59:28 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Flow 'volume_create_manager' (f099c580-fd05-469f-bb33-c68bfca9a57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd09ce9-38d5-4a7b-b373-cfc2fb4d7406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd09ce9-38d5-4a7b-b373-cfc2fb4d7406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d62c1fe-e1a3-4f05-9735-155fd0eb4708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe8e1e0ab214935ba2c6d98b7e92407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:28Z,use_quota=True,user_id='d732febf912d49ecb009fedf5c127255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba30351-a428-4259-81bc-5afd520ff4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba30351-a428-4259-81bc-5afd520ff4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec31b5e-52bd-4253-9cd6-cd5681eeab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec31b5e-52bd-4253-9cd6-cd5681eeab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d62c1fe-e1a3-4f05-9735-155fd0eb4708', 'volume_name': 'volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708', 'volume_size': 1, 'snapshot_id': 'd3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bb4e21-d7a6-499f-b953-349ea5f699e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bb4e21-d7a6-499f-b953-349ea5f699e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bd4592-07ce-4403-92dd-8de627ef94d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:28 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Volume 8d62c1fe-e1a3-4f05-9735-155fd0eb4708: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708', 'volume_size': 1, 'snapshot_id': 'd3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9'} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:28 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 1G" returned: 0 in 0.899s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:28 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 Jul 05 19:59:28 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:29 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96" returned: 0 in 0.706s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:29 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 is being set with open permissions: ugo+rw Jul 05 19:59:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:29 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 Jul 05 19:59:29 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:30 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96" returned: 0 in 0.659s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:30 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.info Jul 05 19:59:30 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:31 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.info" returned: 0 in 0.664s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:31 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.info is being set with open permissions: ugo+rw Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:31 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.info Jul 05 19:59:31 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:31 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.info" returned: 0 in 0.645s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.528s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1974856151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2bff11-48b5-41a2-ac92-94c9772e47ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:27Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Creating volume fc2bff11-48b5-41a2-ac92-94c9772e47ff {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:59:31 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:59:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:31 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff 1073741824 Jul 05 19:59:31 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:31 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7c0ecef8-04da-4660-b0bc-a1aae60b0c4a tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-eba4acef-d9fa-4754-8da8-59830722fe96-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-eba4acef-d9fa-4754-8da8-59830722fe96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:32 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff 1073741824" returned: 0 in 0.800s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-eba4acef-d9fa-4754-8da8-59830722fe96" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-eba4acef-d9fa-4754-8da8-59830722fe96" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Deleting offline snapshot eba4acef-d9fa-4754-8da8-59830722fe96 of volume 8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] snapshot_file for this snap is: volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[babc34c7-19c5-4aca-9af2-535236422166]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:32 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff Jul 05 19:59:32 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:32 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 Jul 05 19:59:32 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:33 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff" returned: 0 in 0.686s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.075s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "cinder-quobyte-d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" by "_create_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f5712e-52ef-452a-98e6-d18520b3cd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f8f3a1-996d-47fa-b4df-5f7fd1ae9aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Creating volume 8d62c1fe-e1a3-4f05-9735-155fd0eb4708 from snapshot d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 {{(pid=86389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "cinder-quobyte-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" by "_copy_volume_from_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:33 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Volume volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff (fc2bff11-48b5-41a2-ac92-94c9772e47ff): created successfully Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f8f3a1-996d-47fa-b4df-5f7fd1ae9aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (78bbfc3a-9e39-4abf-8e16-7f63ac8dabcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] snapshot: d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9, volume: 8d62c1fe-e1a3-4f05-9735-155fd0eb4708, {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 19:59:33 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ba70dba7-4b33-460b-9ec5-b063a2ace01b tempest-ProjectReaderTests-1933739378 None] Created volume successfully. Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96" returned: 0 in 0.805s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b553a618-4f59-41ca-917f-4aff7cad6635]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[100e1af7-fc39-441a-94ad-c34d8e220524]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:33 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e Jul 05 19:59:33 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:33 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 Jul 05 19:59:33 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:34 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" returned: 0 in 0.802s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:34 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 Jul 05 19:59:34 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:34 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9" returned: 0 in 0.842s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0693a15a-817c-4fc5-a540-999b4a6f622d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Creating direct copy from snapshot {{(pid=86389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc51f81-2394-478f-aad2-7d625a8bf0e7]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:34 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d Jul 05 19:59:34 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:34 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96" returned: 0 in 0.753s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:34 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96 Jul 05 19:59:34 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:35 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d" returned: 0 in 0.764s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:35 devstack cinder-volume[86389]: DEBUG cinder.utils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Path /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 not found in is_blk_device check {{(pid=86389) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 19:59:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:35 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 Jul 05 19:59:35 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:35 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e.eba4acef-d9fa-4754-8da8-59830722fe96" returned: 0 in 0.652s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-eba4acef-d9fa-4754-8da8-59830722fe96" released by "_delete_snapshot" :: held 3.138s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" released by "delete_snapshot" :: held 3.161s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:35 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Created reservations ['f410293b-8f30-4294-ba7b-e1c463086572', '3afed66a-4d2e-4500-acaf-5dfb0080fc4a', '3787cf02-17ad-43c8-ba51-8a471eb270b8', 'c655b509-b5b9-400a-9518-1392463979a2'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Delete snapshot completed successfully. Jul 05 19:59:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7713e836-391e-49b8-a2ce-44ad8ad4a8c6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-eba4acef-d9fa-4754-8da8-59830722fe96-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Lock "cinder-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:37 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9664fe5c-5199-4f58-a204-0c2d57a49249]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:37 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e Jul 05 19:59:37 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:38 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" returned: 0 in 1.540s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:38 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e Jul 05 19:59:38 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:39 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" returned: 0 in 1.228s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e" released by "delete_volume" :: held 2.908s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:39 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=146,cinder:SELECT=116,cinder:INSERT=36,cinder:DELETE=11 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:59:39 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=116,cinder:INSERT=48,cinder:UPDATE=144,cinder:DELETE=12 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Created reservations ['d1512b5f-d5ba-4b64-a617-883e7edea034', '0025f79d-aaf6-4e7d-bf4a-9c03061591fb', 'a506d337-0776-4984-b301-511bc944aef7', '13ed3f9f-3de9-49e9-bc90-00159d3c86d0'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:40 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:40 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:40 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" returned: 0 in 5.299s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18a11d1-b721-44a6-bc40-8e2592f647c3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:40 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d Jul 05 19:59:40 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:40 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.742s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:59:40 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Deleted volume successfully. Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (d8eaec10-2ee2-45c3-87f5-d148662e37ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d423122f-ae98-43e3-bf52-f4c237ce5f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d423122f-ae98-43e3-bf52-f4c237ce5f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503742238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ab4798-880a-43c9-bbac-f91b448e9951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:41Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89a4532-3abd-4d5a-91d3-3c8c0116a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89a4532-3abd-4d5a-91d3-3c8c0116a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf5e0a8-de6b-4241-a70d-577097e19e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf5e0a8-de6b-4241-a70d-577097e19e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ab4798-880a-43c9-bbac-f91b448e9951', 'volume_name': 'volume-13ab4798-880a-43c9-bbac-f91b448e9951', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698bbe87-0bcb-4abb-8e49-f92a46510d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698bbe87-0bcb-4abb-8e49-f92a46510d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48968c8-67ca-4e92-a5c1-675143529dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:40 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Volume 13ab4798-880a-43c9-bbac-f91b448e9951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ab4798-880a-43c9-bbac-f91b448e9951', 'volume_size': 1} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-c7509426-a1de-4802-853b-070639245d73 tempest-ProjectMemberTests-127409771 None] Lock "cinder-8613bb3d-4fa2-413b-bd4b-d6e8442b8a7e-delete_volume" released by "delete_volume" :: held 4.161s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:41 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d" returned: 0 in 0.946s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:41 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Image conversion details: src /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 {{(pid=86389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 19:59:41 devstack cinder-volume[86389]: INFO cinder.image.image_utils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Converted 1024.00 MB image at 193.21 MB/s Jul 05 19:59:41 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 is being set with open permissions: ugo+rw Jul 05 19:59:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:41 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 Jul 05 19:59:41 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:41 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" returned: 0 in 0.649s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" released by "_copy_volume_from_snapshot" :: held 8.629s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" released by "_create_volume_from_snapshot" :: held 8.683s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.717s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.826s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:41 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Creating offline snapshot 1e4eeaed-650e-49d7-8edd-82020f5f4601 of volume fc2bff11-48b5-41a2-ac92-94c9772e47ff {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bd4592-07ce-4403-92dd-8de627ef94d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708', 'volume_size': 1, 'snapshot_id': 'd3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9'}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6826bc40-39a6-4cc3-9aa9-c7d4960de993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcb81d1-985a-4c2d-b139-42b46200f635]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:42 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Volume volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 (8d62c1fe-e1a3-4f05-9735-155fd0eb4708): created successfully Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6826bc40-39a6-4cc3-9aa9-c7d4960de993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Flow 'volume_create_manager' (f099c580-fd05-469f-bb33-c68bfca9a57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-576dbd3c-321d-4352-9f7f-0a28e6c589f0 tempest-SnapshotDependencyTests-1461749044 None] Created volume successfully. Jul 05 19:59:42 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff Jul 05 19:59:42 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "cinder-d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "cinder-quobyte-0693a15a-817c-4fc5-a540-999b4a6f622d" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-0693a15a-817c-4fc5-a540-999b4a6f622d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "cinder-quobyte-d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Deleting offline snapshot d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 of volume 0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] snapshot_file for this snap is: volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf37f1ca-05dc-46fb-8774-ee4607adab5a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:42 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 Jul 05 19:59:42 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:42 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff" returned: 0 in 0.755s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:42 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601 1G Jul 05 19:59:42 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:43 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9" returned: 0 in 0.754s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0693a15a-817c-4fc5-a540-999b4a6f622d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:59:43 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f57e63-629e-4dd1-a613-dda7be29fff4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:43 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d Jul 05 19:59:43 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:43 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601 1G" returned: 0 in 0.802s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:43 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601 Jul 05 19:59:43 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:43 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d" returned: 0 in 0.797s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:43 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:43 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 Jul 05 19:59:43 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:44 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601" returned: 0 in 0.697s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:44 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601 is being set with open permissions: ugo+rw Jul 05 19:59:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:44 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601 Jul 05 19:59:44 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:44 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9" returned: 0 in 0.717s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:44 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9 Jul 05 19:59:44 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:44 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.1e4eeaed-650e-49d7-8edd-82020f5f4601" returned: 0 in 0.659s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:45 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.info Jul 05 19:59:45 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:45 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d.d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9" returned: 0 in 0.657s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9" released by "_delete_snapshot" :: held 3.024s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-0693a15a-817c-4fc5-a540-999b4a6f622d" released by "delete_snapshot" :: held 3.050s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:45 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Created reservations ['436616a1-743d-484c-be94-f02bd692e35c', 'ca04af1f-2da4-4b48-a8c8-6ceec8461618', '9adfa3a3-f45d-4c71-8d04-a15f983a478d', 'cf77b14b-3b58-46fc-8ac1-b533bc399570'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:45 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Delete snapshot completed successfully. Jul 05 19:59:45 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e13386a8-d22d-4c8a-9252-dc34e635adaf tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-d3cb2def-abd2-4da2-aecb-6d7c7ba4f9f9-delete_snapshot" released by "delete_snapshot" :: held 3.198s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:45 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.info" returned: 0 in 0.646s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:45 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.info is being set with open permissions: ugo+rw Jul 05 19:59:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:45 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.info Jul 05 19:59:45 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:46 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-fc2bff11-48b5-41a2-ac92-94c9772e47ff.info" returned: 0 in 0.630s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.286s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.286s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T17:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503742238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ab4798-880a-43c9-bbac-f91b448e9951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T17:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T17:59:41Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Creating volume 13ab4798-880a-43c9-bbac-f91b448e9951 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 19:59:46 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:46 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 1073741824 Jul 05 19:59:46 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-5a119ad0-4687-4dac-af19-6f90915af6d2 tempest-ProjectReaderTests-1933739378 None] Create snapshot completed successfully Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "cinder-0693a15a-817c-4fc5-a540-999b4a6f622d-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-0693a15a-817c-4fc5-a540-999b4a6f622d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "cinder-quobyte-0693a15a-817c-4fc5-a540-999b4a6f622d" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-0693a15a-817c-4fc5-a540-999b4a6f622d" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d934f9b6-5749-4ef1-9b63-5ad1f0029ddb]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:46 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d Jul 05 19:59:46 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-49f83557-4a5a-49b9-820f-bedbc1c09376 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-1e4eeaed-650e-49d7-8edd-82020f5f4601-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-49f83557-4a5a-49b9-820f-bedbc1c09376 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-1e4eeaed-650e-49d7-8edd-82020f5f4601-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:46 devstack cinder-volume[86389]: INFO cinder.message.api [None req-49f83557-4a5a-49b9-820f-bedbc1c09376 tempest-ProjectReaderTests-1933739378 None] Creating message record for request_id = req-49f83557-4a5a-49b9-820f-bedbc1c09376 Jul 05 19:59:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-49f83557-4a5a-49b9-820f-bedbc1c09376 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-1e4eeaed-650e-49d7-8edd-82020f5f4601-delete_snapshot" released by "delete_snapshot" :: held 0.041s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server [None req-49f83557-4a5a-49b9-820f-bedbc1c09376 tempest-ProjectReaderTests-1933739378 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 19:59:46 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server Jul 05 19:59:47 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 1073741824" returned: 0 in 0.851s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:47 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 Jul 05 19:59:47 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:47 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d" returned: 0 in 0.822s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:47 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d Jul 05 19:59:47 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:47 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951" returned: 0 in 0.643s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48968c8-67ca-4e92-a5c1-675143529dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ab4798-880a-43c9-bbac-f91b448e9951', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8469bd-f493-4e48-990b-c6dcc25353a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 19:59:47 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Volume volume-13ab4798-880a-43c9-bbac-f91b448e9951 (13ab4798-880a-43c9-bbac-f91b448e9951): created successfully Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8469bd-f493-4e48-990b-c6dcc25353a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 19:59:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (d8eaec10-2ee2-45c3-87f5-d148662e37ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 19:59:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ab74f82d-9389-44a8-96b2-b0be34e6aef0 tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 19:59:48 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-0693a15a-817c-4fc5-a540-999b4a6f622d" returned: 0 in 0.643s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-0693a15a-817c-4fc5-a540-999b4a6f622d" released by "delete_volume" :: held 1.514s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Created reservations ['bd3f65a9-5199-4dea-bacc-70ee0e6e3af0', '1e043647-df23-4b92-abe8-d44331686c27', '896f99d4-a33a-4531-8a20-364e78350eba', '4d9bce5f-60f7-446d-ae18-a308b51fd207'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:48 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:48 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Creating offline snapshot ac1cba29-e57d-49b1-b796-3c53d15a73ae of volume 13ab4798-880a-43c9-bbac-f91b448e9951 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b57d9a-9ca9-491e-9c62-8065308ed9fa]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:48 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 Jul 05 19:59:48 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "cinder-8d62c1fe-e1a3-4f05-9735-155fd0eb4708-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-8d62c1fe-e1a3-4f05-9735-155fd0eb4708-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "cinder-quobyte-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d9da3-53a3-4e26-bde2-919896ec4e7f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:48 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.737s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:59:48 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Deleted volume successfully. Jul 05 19:59:48 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 Jul 05 19:59:48 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb057feb-768b-4f78-9039-4b7adff2b84a tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-0693a15a-817c-4fc5-a540-999b4a6f622d-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:49 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951" returned: 0 in 0.764s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:49 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae 1G Jul 05 19:59:49 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:49 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" returned: 0 in 0.791s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:49 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708 Jul 05 19:59:49 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:50 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae 1G" returned: 0 in 0.809s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ab4798-880a-43c9-bbac-f91b448e9951 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:50 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ab4798-880a-43c9-bbac-f91b448e9951 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae Jul 05 19:59:50 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:50 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" returned: 0 in 0.677s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-quobyte-8d62c1fe-e1a3-4f05-9735-155fd0eb4708" released by "delete_volume" :: held 1.509s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Created reservations ['76064db7-e05b-493b-b017-78dc072100f9', '76a9a464-07e8-4ea2-a13d-ec881f9b73cd', 'b6d04dfe-4190-483d-a4cf-2cd8e0ef2a0f', '7faf46d7-f502-47bd-9867-2f89a5f96684'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:50 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:50 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:50 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ab4798-880a-43c9-bbac-f91b448e9951 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae" returned: 0 in 0.700s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:50 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae is being set with open permissions: ugo+rw Jul 05 19:59:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:50 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae Jul 05 19:59:50 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:51 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.671s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:51 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 19:59:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Deleted volume successfully. Jul 05 19:59:51 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-19e2d095-4a68-470f-b963-5c19f8451cc2 tempest-SnapshotDependencyTests-1461749044 None] Lock "cinder-8d62c1fe-e1a3-4f05-9735-155fd0eb4708-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:51 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae" returned: 0 in 0.633s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:51 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.info Jul 05 19:59:51 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:52 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.info" returned: 0 in 0.706s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:52 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.info is being set with open permissions: ugo+rw Jul 05 19:59:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:52 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.info Jul 05 19:59:52 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:52 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.info" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.406s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:52 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-84a13e3c-1506-4a67-8d04-01877eba1bf7 tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-ac1cba29-e57d-49b1-b796-3c53d15a73ae-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Lock "cinder-ac1cba29-e57d-49b1-b796-3c53d15a73ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-13ab4798-880a-43c9-bbac-f91b448e9951" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-13ab4798-880a-43c9-bbac-f91b448e9951" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-ac1cba29-e57d-49b1-b796-3c53d15a73ae" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-ac1cba29-e57d-49b1-b796-3c53d15a73ae" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Deleting offline snapshot ac1cba29-e57d-49b1-b796-3c53d15a73ae of volume 13ab4798-880a-43c9-bbac-f91b448e9951 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] snapshot_file for this snap is: volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b1973e-778f-474a-80b2-2442d4af815e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:53 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae Jul 05 19:59:53 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:54 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae" returned: 0 in 0.824s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:54 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13ab4798-880a-43c9-bbac-f91b448e9951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 19:59:54 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47f579c-cee3-4ab6-b2ba-3d166043ed7c]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:54 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 Jul 05 19:59:54 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:55 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951" returned: 0 in 0.798s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:55 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae Jul 05 19:59:55 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:56 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae" returned: 0 in 0.769s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:56 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae Jul 05 19:59:56 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:56 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951.ac1cba29-e57d-49b1-b796-3c53d15a73ae" returned: 0 in 0.677s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-ac1cba29-e57d-49b1-b796-3c53d15a73ae" released by "_delete_snapshot" :: held 3.182s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-13ab4798-880a-43c9-bbac-f91b448e9951" released by "delete_snapshot" :: held 3.208s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:56 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Created reservations ['97d0348d-5dd0-4260-a730-474eda09206b', 'abd09dd0-522c-4663-8bea-8ae7e33ea882', 'cb74aca0-ea07-4aed-81f9-d30f8cf2c746', '9798ce21-c09b-44e4-80ff-015054ce7c16'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:57 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Delete snapshot completed successfully. Jul 05 19:59:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-d5ce3deb-f3b6-4191-b3cb-a6d65261a3a3 tempest-ProjectMemberTests-127409771 None] Lock "cinder-ac1cba29-e57d-49b1-b796-3c53d15a73ae-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-13ab4798-880a-43c9-bbac-f91b448e9951-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Lock "cinder-13ab4798-880a-43c9-bbac-f91b448e9951-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-13ab4798-880a-43c9-bbac-f91b448e9951" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 19:59:58 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-13ab4798-880a-43c9-bbac-f91b448e9951" acquired by "delete_volume" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 19:59:58 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbf9964-bde1-4bbe-9816-45f28a6aebd1]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 19:59:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:58 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 Jul 05 19:59:58 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:58 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951" returned: 0 in 0.814s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:58 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951 Jul 05 19:59:58 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 19:59:59 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 05 19:59:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-13ab4798-880a-43c9-bbac-f91b448e9951" returned: 0 in 0.690s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 19:59:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-13ab4798-880a-43c9-bbac-f91b448e9951" released by "delete_volume" :: held 1.584s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 19:59:59 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Created reservations ['94756aad-218d-496e-9707-b58229e0c13f', 'b75b11d1-ee15-4f33-bced-d8c6f4ce5871', 'cd4ef602-afe7-41c8-8af1-80a152ea3ef5', 'beb19658-1e09-41a7-afb5-4e63c97166cc'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 19:59:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 19:59:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 19:59:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 19:59:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 19:59:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 19:59:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 19:59:59 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 19:59:59 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:00 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.654s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:00:00 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Deleted volume successfully. Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-12200324-152e-4c11-9bf6-d97281065e21 tempest-ProjectMemberTests-127409771 None] Lock "cinder-13ab4798-880a-43c9-bbac-f91b448e9951-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (96818ad3-27e0-4095-b33b-464fa317b7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5296ac7-a1da-4f22-b52d-a06f04b69612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5296ac7-a1da-4f22-b52d-a06f04b69612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89170889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67079d0f-2bea-41e8-9023-96e66217e488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:00:01Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145b741-cf3d-4349-ab54-5927dd7edebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145b741-cf3d-4349-ab54-5927dd7edebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f502c81-5c0e-4675-922b-bcb22bf5af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f502c81-5c0e-4675-922b-bcb22bf5af3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67079d0f-2bea-41e8-9023-96e66217e488', 'volume_name': 'volume-67079d0f-2bea-41e8-9023-96e66217e488', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5622ad18-3dde-48eb-8ba1-faa1bac4db6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5622ad18-3dde-48eb-8ba1-faa1bac4db6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2920ef6f-0dd3-4e85-8634-8980eff64f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:00 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Volume 67079d0f-2bea-41e8-9023-96e66217e488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67079d0f-2bea-41e8-9023-96e66217e488', 'volume_size': 1} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89170889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67079d0f-2bea-41e8-9023-96e66217e488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:00:01Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Creating volume 67079d0f-2bea-41e8-9023-96e66217e488 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:00:00 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:00:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:00 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 1073741824 Jul 05 20:00:00 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:01 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 1073741824" returned: 0 in 0.803s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:01 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 Jul 05 20:00:01 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:02 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488" returned: 0 in 0.641s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2920ef6f-0dd3-4e85-8634-8980eff64f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67079d0f-2bea-41e8-9023-96e66217e488', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe255f4-dcbd-4fa3-9bc8-d23a65cff883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:02 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Volume volume-67079d0f-2bea-41e8-9023-96e66217e488 (67079d0f-2bea-41e8-9023-96e66217e488): created successfully Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe255f4-dcbd-4fa3-9bc8-d23a65cff883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (96818ad3-27e0-4095-b33b-464fa317b7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:00:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-85f80cc6-9f0e-44b4-82d6-de0bb9511314 tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Creating offline snapshot bfec8c96-b992-402a-b01d-90fe50aafb1d of volume 67079d0f-2bea-41e8-9023-96e66217e488 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abdfd6c-2aab-47a8-9bac-a4b7f700ff63]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:00:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:03 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 Jul 05 20:00:03 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:03 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488" returned: 0 in 0.746s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:03 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d 1G Jul 05 20:00:03 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:04 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d 1G" returned: 0 in 0.826s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67079d0f-2bea-41e8-9023-96e66217e488 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:04 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67079d0f-2bea-41e8-9023-96e66217e488 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d Jul 05 20:00:04 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:05 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67079d0f-2bea-41e8-9023-96e66217e488 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d" returned: 0 in 0.701s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:05 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d is being set with open permissions: ugo+rw Jul 05 20:00:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:05 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d Jul 05 20:00:05 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:05 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d" returned: 0 in 0.644s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:05 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.info Jul 05 20:00:05 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:06 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.info" returned: 0 in 0.657s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:06 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.info is being set with open permissions: ugo+rw Jul 05 20:00:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:06 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.info Jul 05 20:00:06 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:07 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.info" returned: 0 in 0.650s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.300s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:07 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-cb5c987b-2d3a-4a6c-8592-373c44ddcea2 tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-bfec8c96-b992-402a-b01d-90fe50aafb1d-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Lock "cinder-bfec8c96-b992-402a-b01d-90fe50aafb1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-67079d0f-2bea-41e8-9023-96e66217e488" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-67079d0f-2bea-41e8-9023-96e66217e488" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-bfec8c96-b992-402a-b01d-90fe50aafb1d" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-bfec8c96-b992-402a-b01d-90fe50aafb1d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Deleting offline snapshot bfec8c96-b992-402a-b01d-90fe50aafb1d of volume 67079d0f-2bea-41e8-9023-96e66217e488 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] snapshot_file for this snap is: volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[04afab9c-8cc7-4cb1-9690-e44023d22be1]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:08 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d Jul 05 20:00:08 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:08 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d" returned: 0 in 0.770s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67079d0f-2bea-41e8-9023-96e66217e488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:00:09 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c361d9-5272-4cdf-94e1-e7835b120a75]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:00:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:09 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 Jul 05 20:00:09 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:09 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488" returned: 0 in 0.759s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:09 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d Jul 05 20:00:09 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:10 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d" returned: 0 in 0.734s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:10 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d Jul 05 20:00:10 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:11 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488.bfec8c96-b992-402a-b01d-90fe50aafb1d" returned: 0 in 0.631s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-bfec8c96-b992-402a-b01d-90fe50aafb1d" released by "_delete_snapshot" :: held 2.984s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-67079d0f-2bea-41e8-9023-96e66217e488" released by "delete_snapshot" :: held 3.006s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Created reservations ['48b982b0-5c3e-4a6c-bdf9-6b487319e1c9', '2c85f127-09c0-4642-a5fb-189df81b55b3', '987da332-711e-44b5-9e1d-66a817560134', '6a3c71f6-13cc-4707-b561-f641117116ae'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:00:11 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Delete snapshot completed successfully. Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-097a39fa-7712-4c3d-918b-5a0bf75df7d5 tempest-ProjectMemberTests-127409771 None] Lock "cinder-bfec8c96-b992-402a-b01d-90fe50aafb1d-delete_snapshot" released by "delete_snapshot" :: held 3.141s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-67079d0f-2bea-41e8-9023-96e66217e488-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Lock "cinder-67079d0f-2bea-41e8-9023-96e66217e488-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-67079d0f-2bea-41e8-9023-96e66217e488" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-67079d0f-2bea-41e8-9023-96e66217e488" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[982cd25a-71d3-44b5-8a12-c9660bb394e5]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:00:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:11 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 Jul 05 20:00:11 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:12 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488" returned: 0 in 0.750s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:12 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488 Jul 05 20:00:12 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:12 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-67079d0f-2bea-41e8-9023-96e66217e488" returned: 0 in 0.650s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-67079d0f-2bea-41e8-9023-96e66217e488" released by "delete_volume" :: held 1.471s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Created reservations ['3fefb239-e6d1-483f-9436-1390f8eedf88', '2c7ce14a-05f6-4c38-9669-8d00b47c0c1c', 'bb1d404d-855d-485c-9303-c3ff9bf19c21', 'b9eaa0f3-ac56-4d99-aad8-fae9cf9c0e3f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:13 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:00:13 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:13 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.630s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:13 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:00:13 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Deleted volume successfully. Jul 05 20:00:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-7b195d62-d404-40ad-9f46-27adc9544631 tempest-ProjectMemberTests-127409771 None] Lock "cinder-67079d0f-2bea-41e8-9023-96e66217e488-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:13 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (87428f21-75fa-4e76-96bd-541028346f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfffa9d-8d5a-4b8a-a378-8b88a66f2ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfffa9d-8d5a-4b8a-a378-8b88a66f2ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107897202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:00:14Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cdd2fe-4d6f-4feb-bcb7-dc1d15dfe227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cdd2fe-4d6f-4feb-bcb7-dc1d15dfe227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0f5c1b-3fda-41b4-a267-4799057a17c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0f5c1b-3fda-41b4-a267-4799057a17c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef', 'volume_name': 'volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68169c52-437c-4137-9e44-55bbb4a09452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68169c52-437c-4137-9e44-55bbb4a09452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60250281-72dc-4205-ba4a-dec1dca585a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:14 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Volume 3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef', 'volume_size': 1} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107897202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:00:14Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Creating volume 3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:00:14 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:14 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef 1073741824 Jul 05 20:00:14 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:14 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef 1073741824" returned: 0 in 0.862s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:15 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef Jul 05 20:00:15 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:15 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" returned: 0 in 0.643s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:00:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60250281-72dc-4205-ba4a-dec1dca585a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02b7a37-e9aa-4256-9623-0c0c3ed637a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:15 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Volume volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef (3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef): created successfully Jul 05 20:00:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02b7a37-e9aa-4256-9623-0c0c3ed637a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (87428f21-75fa-4e76-96bd-541028346f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:00:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7ccd7c5e-cc78-4774-b77a-e59688bb7ef1 tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:16 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:00:16 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Creating offline snapshot 7a473d63-0941-43e9-9253-184f719bde93 of volume 3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdb8769-870b-4bc0-b91a-f976f84b9c02]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:16 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef Jul 05 20:00:16 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:16 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.671s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 20:00:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 20:00:17 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" returned: 0 in 0.741s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:17 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 1G Jul 05 20:00:17 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:17 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 1G" returned: 0 in 0.793s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:17 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 Jul 05 20:00:17 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:18 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93" returned: 0 in 0.685s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:18 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 is being set with open permissions: ugo+rw Jul 05 20:00:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:18 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 Jul 05 20:00:18 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:19 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93" returned: 0 in 0.635s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:19 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.info Jul 05 20:00:19 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:19 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.info" returned: 0 in 0.666s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:19 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.info is being set with open permissions: ugo+rw Jul 05 20:00:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:19 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.info Jul 05 20:00:19 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:20 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.info" returned: 0 in 0.664s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.275s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ad79fba4-f285-4085-9cf6-90ed7d0555fc tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-7a473d63-0941-43e9-9253-184f719bde93-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Lock "cinder-7a473d63-0941-43e9-9253-184f719bde93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-7a473d63-0941-43e9-9253-184f719bde93" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-7a473d63-0941-43e9-9253-184f719bde93" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Deleting offline snapshot 7a473d63-0941-43e9-9253-184f719bde93 of volume 3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] snapshot_file for this snap is: volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d360566a-c902-4fb3-b782-35e41f359b4b]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:00:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:21 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 Jul 05 20:00:21 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:22 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93" returned: 0 in 0.761s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:00:22 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e9085-fdde-4736-9881-60d8de1143a3]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:00:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:22 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef Jul 05 20:00:22 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:23 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" returned: 0 in 0.763s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:23 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 Jul 05 20:00:23 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:23 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93" returned: 0 in 0.725s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:23 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93 Jul 05 20:00:23 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:24 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef.7a473d63-0941-43e9-9253-184f719bde93" returned: 0 in 0.638s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-7a473d63-0941-43e9-9253-184f719bde93" released by "_delete_snapshot" :: held 2.973s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" released by "delete_snapshot" :: held 2.996s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Created reservations ['464140b8-396b-4d15-a9cc-3c1cf8e15402', 'cee4fdb8-b74e-4070-b876-a2e0c124de7d', '854993a9-099f-4e7b-ae10-00e7f25907ba', '5f948d63-c1c4-4324-a8fe-7d44d08cf27f'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:00:24 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Delete snapshot completed successfully. Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b80ae826-e73d-448a-af68-e0ffdd2e46ca tempest-ProjectMemberTests-127409771 None] Lock "cinder-7a473d63-0941-43e9-9253-184f719bde93-delete_snapshot" released by "delete_snapshot" :: held 3.128s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Lock "cinder-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" acquired by "delete_volume" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61a8f13-f847-4648-a300-f9b02320af9d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:00:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:24 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef Jul 05 20:00:24 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:25 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" returned: 0 in 0.758s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:25 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef Jul 05 20:00:25 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:26 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" returned: 0 in 0.657s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef" released by "delete_volume" :: held 1.468s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Created reservations ['aeef3a0d-887b-4969-91d8-2769e87476ac', 'e660d274-a366-4778-9da4-1f0517644161', 'c0cd1b32-267b-436e-89cd-41c988c8460a', 'f6ca7cc0-9078-43e2-b51f-506f551d09e3'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:26 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:00:26 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:26 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.674s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:00:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Deleted volume successfully. Jul 05 20:00:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0b2ff843-2d19-45fc-9dc3-90c4433ecda0 tempest-ProjectMemberTests-127409771 None] Lock "cinder-3e2d48c2-583e-42dd-a0b2-9a4ea0a2a5ef-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (a9612c58-a1cd-4fc8-b3e2-6f5ffd609aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c69695-3ccc-4471-8c01-aa57ca3cb16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c69695-3ccc-4471-8c01-aa57ca3cb16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-32275321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8219a00c-54ab-4346-8fbc-6297c3211d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:00:27Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5037f2c-46d2-44c2-b213-a8807e87fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5037f2c-46d2-44c2-b213-a8807e87fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d676855-d581-495b-844b-354bba8905a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d676855-d581-495b-844b-354bba8905a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8219a00c-54ab-4346-8fbc-6297c3211d55', 'volume_name': 'volume-8219a00c-54ab-4346-8fbc-6297c3211d55', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1e26d9-901f-4dbb-9c93-b32d168d63e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1e26d9-901f-4dbb-9c93-b32d168d63e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e89a61f-9297-4d6d-90e7-47d2cb9b6cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:27 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Volume 8219a00c-54ab-4346-8fbc-6297c3211d55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8219a00c-54ab-4346-8fbc-6297c3211d55', 'volume_size': 1} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-32275321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8219a00c-54ab-4346-8fbc-6297c3211d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:00:27Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Creating volume 8219a00c-54ab-4346-8fbc-6297c3211d55 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:00:27 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:00:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:27 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55 1073741824 Jul 05 20:00:27 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:28 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55 1073741824" returned: 0 in 0.794s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:28 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55 Jul 05 20:00:28 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:28 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55" returned: 0 in 0.651s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:00:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e89a61f-9297-4d6d-90e7-47d2cb9b6cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8219a00c-54ab-4346-8fbc-6297c3211d55', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9b4a4e-e179-403c-8fed-ac2b884cb8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:00:28 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Volume volume-8219a00c-54ab-4346-8fbc-6297c3211d55 (8219a00c-54ab-4346-8fbc-6297c3211d55): created successfully Jul 05 20:00:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9b4a4e-e179-403c-8fed-ac2b884cb8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:00:28 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (a9612c58-a1cd-4fc8-b3e2-6f5ffd609aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:00:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f2a042f6-2caa-4b7a-99f2-2e671014b610 tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 20:00:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:00:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:00:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Creating offline snapshot 5aeaf785-3845-4a24-b76d-7d9aab417ad0 of volume 8219a00c-54ab-4346-8fbc-6297c3211d55 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:00:29 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0616090-0078-4178-bda0-bb976e6fd269]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:00:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:29 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55 Jul 05 20:00:29 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:30 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55" returned: 0 in 0.768s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:30 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0 1G Jul 05 20:00:30 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:31 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0 1G" returned: 0 in 0.777s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8219a00c-54ab-4346-8fbc-6297c3211d55 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:31 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8219a00c-54ab-4346-8fbc-6297c3211d55 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0 Jul 05 20:00:31 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:31 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8219a00c-54ab-4346-8fbc-6297c3211d55 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0" returned: 0 in 0.688s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:31 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0 is being set with open permissions: ugo+rw Jul 05 20:00:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:31 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0 Jul 05 20:00:31 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:32 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.5aeaf785-3845-4a24-b76d-7d9aab417ad0" returned: 0 in 0.642s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:32 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.info Jul 05 20:00:32 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:33 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.info" returned: 0 in 0.645s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:33 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.info is being set with open permissions: ugo+rw Jul 05 20:00:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:00:33 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.info Jul 05 20:00:33 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:00:33 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 05 20:00:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8219a00c-54ab-4346-8fbc-6297c3211d55.info" returned: 0 in 0.630s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:00:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.231s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:00:33 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f320d0a9-588c-4d94-93f6-625505fe841d tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 20:00:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0f88e6bd-f751-467e-98ed-82047e2f43f6 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-5aeaf785-3845-4a24-b76d-7d9aab417ad0-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:00:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0f88e6bd-f751-467e-98ed-82047e2f43f6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-5aeaf785-3845-4a24-b76d-7d9aab417ad0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:00:34 devstack cinder-volume[86389]: INFO cinder.message.api [None req-0f88e6bd-f751-467e-98ed-82047e2f43f6 tempest-ProjectMemberTests-127409771 None] Creating message record for request_id = req-0f88e6bd-f751-467e-98ed-82047e2f43f6 Jul 05 20:00:34 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0f88e6bd-f751-467e-98ed-82047e2f43f6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-5aeaf785-3845-4a24-b76d-7d9aab417ad0-delete_snapshot" released by "delete_snapshot" :: held 0.034s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server [None req-0f88e6bd-f751-467e-98ed-82047e2f43f6 tempest-ProjectMemberTests-127409771 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 20:00:34 devstack cinder-volume[86389]: ERROR oslo_messaging.rpc.server Jul 05 20:00:43 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=73,cinder:INSERT=29,cinder:UPDATE=95,cinder:DELETE=5 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:00:44 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=87,cinder:SELECT=64,cinder:DELETE=11,cinder:INSERT=22 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:01:09 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:01:09 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:01:16 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:01:16 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:01:16 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.651s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 20:01:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 20:02:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:02:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 20:02:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (1dccb859-f54c-4462-b2d0-3c011938f1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b0f4df-515d-4069-b0ab-5a0d633a43f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b0f4df-515d-4069-b0ab-5a0d633a43f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999644797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57538c5e-91f4-44ce-9225-754efded94e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:03Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2cc912-a5d4-41d8-8c1e-45e16646ca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2cc912-a5d4-41d8-8c1e-45e16646ca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ca0df6-8c9e-4c8a-babc-fcbe72c07a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ca0df6-8c9e-4c8a-babc-fcbe72c07a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57538c5e-91f4-44ce-9225-754efded94e8', 'volume_name': 'volume-57538c5e-91f4-44ce-9225-754efded94e8', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb57d09d-929d-4adb-a3b6-d0444c65c3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb57d09d-929d-4adb-a3b6-d0444c65c3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b544859-30e4-4380-bfba-6e1dc43b3623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:02 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Volume 57538c5e-91f4-44ce-9225-754efded94e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57538c5e-91f4-44ce-9225-754efded94e8', 'volume_size': 1} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999644797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57538c5e-91f4-44ce-9225-754efded94e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:03Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Creating volume 57538c5e-91f4-44ce-9225-754efded94e8 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:03:02 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:03:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:02 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 1073741824 Jul 05 20:03:02 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:03 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 1073741824" returned: 0 in 0.798s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:03 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 Jul 05 20:03:03 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:04 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8" returned: 0 in 0.645s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:03:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b544859-30e4-4380-bfba-6e1dc43b3623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57538c5e-91f4-44ce-9225-754efded94e8', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da04943-b060-4649-9100-184ef34dac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:04 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Volume volume-57538c5e-91f4-44ce-9225-754efded94e8 (57538c5e-91f4-44ce-9225-754efded94e8): created successfully Jul 05 20:03:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da04943-b060-4649-9100-184ef34dac75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:04 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (1dccb859-f54c-4462-b2d0-3c011938f1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:04 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-587f6a1d-e07f-4485-98a6-d7c17ad58098 tempest-ProjectReaderTests-1933739378 None] Created volume successfully. Jul 05 20:03:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Creating offline snapshot c64785d1-5507-4dff-8aa8-44138a00c3d4 of volume 57538c5e-91f4-44ce-9225-754efded94e8 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:03:05 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[034babd2-2028-4f4d-9292-edea772c1725]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:05 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 Jul 05 20:03:05 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:05 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8" returned: 0 in 0.764s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:05 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 1G Jul 05 20:03:05 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:06 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 1G" returned: 0 in 0.792s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57538c5e-91f4-44ce-9225-754efded94e8 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:06 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57538c5e-91f4-44ce-9225-754efded94e8 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 Jul 05 20:03:06 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:07 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57538c5e-91f4-44ce-9225-754efded94e8 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4" returned: 0 in 0.679s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:07 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 is being set with open permissions: ugo+rw Jul 05 20:03:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:07 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 Jul 05 20:03:07 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:07 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4" returned: 0 in 0.642s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:08 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.info Jul 05 20:03:08 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:08 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.info" returned: 0 in 0.646s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:08 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.info is being set with open permissions: ugo+rw Jul 05 20:03:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:08 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.info Jul 05 20:03:08 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:09 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.info" returned: 0 in 0.627s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:09 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-75433c26-52ef-410f-8137-3e38660a9c96 tempest-ProjectReaderTests-1933739378 None] Create snapshot completed successfully Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-c64785d1-5507-4dff-8aa8-44138a00c3d4-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-c64785d1-5507-4dff-8aa8-44138a00c3d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-57538c5e-91f4-44ce-9225-754efded94e8" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-57538c5e-91f4-44ce-9225-754efded94e8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-c64785d1-5507-4dff-8aa8-44138a00c3d4" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-c64785d1-5507-4dff-8aa8-44138a00c3d4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Deleting offline snapshot c64785d1-5507-4dff-8aa8-44138a00c3d4 of volume 57538c5e-91f4-44ce-9225-754efded94e8 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] snapshot_file for this snap is: volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ff70a-87d8-4a41-ac3d-01564c22cb68]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:10 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 Jul 05 20:03:10 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:11 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4" returned: 0 in 0.750s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57538c5e-91f4-44ce-9225-754efded94e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:03:11 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d05152-a442-4286-ad9e-2eb3679095a1]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:11 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 Jul 05 20:03:11 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:11 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8" returned: 0 in 0.736s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:11 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 Jul 05 20:03:11 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:12 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4" returned: 0 in 0.720s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:12 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4 Jul 05 20:03:12 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:13 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8.c64785d1-5507-4dff-8aa8-44138a00c3d4" returned: 0 in 0.647s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-c64785d1-5507-4dff-8aa8-44138a00c3d4" released by "_delete_snapshot" :: held 2.944s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-57538c5e-91f4-44ce-9225-754efded94e8" released by "delete_snapshot" :: held 2.967s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Created reservations ['85b93a15-114b-4eba-a89f-9a6621c05e82', '15f39801-06f3-4192-8d27-793846c44bdc', 'c1a07f79-4b37-401d-87ac-eb0ab13213f5', '9d19304a-0b57-4f12-8349-79f5acea5096'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:03:13 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Delete snapshot completed successfully. Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-eac3d85f-379f-4b3a-9d96-b0fba702aa70 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-c64785d1-5507-4dff-8aa8-44138a00c3d4-delete_snapshot" released by "delete_snapshot" :: held 3.096s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-57538c5e-91f4-44ce-9225-754efded94e8-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Lock "cinder-57538c5e-91f4-44ce-9225-754efded94e8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-57538c5e-91f4-44ce-9225-754efded94e8" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-57538c5e-91f4-44ce-9225-754efded94e8" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[76de6849-300d-482a-9d77-c8ca5a586368]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:13 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 Jul 05 20:03:13 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:14 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8" returned: 0 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:14 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8 Jul 05 20:03:14 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:14 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-57538c5e-91f4-44ce-9225-754efded94e8" returned: 0 in 0.634s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:14 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-57538c5e-91f4-44ce-9225-754efded94e8" released by "delete_volume" :: held 1.434s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:14 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Created reservations ['a5bb8e8a-48de-48f2-8451-1e8f294e79c9', '771ddef5-a752-4930-8942-1b39f1af3129', '8bacccee-0edc-420a-bc56-a92238924fb2', 'b8618eff-e8ea-4ec6-9789-43ec3f1e40fc'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:03:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:15 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:03:15 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:15 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.649s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:15 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:03:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Deleted volume successfully. Jul 05 20:03:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-b60568cd-e6b2-4fc9-b9ee-d49a5b45587a tempest-ProjectReaderTests-1933739378 None] Lock "cinder-57538c5e-91f4-44ce-9225-754efded94e8-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (a81bfb97-8ec5-4719-bb07-a29ea9836a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5c6ed4-69c0-4c67-9e11-b03e7bb54829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5c6ed4-69c0-4c67-9e11-b03e7bb54829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324275752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28c9196-54ba-4c1a-b500-c6b0c836fcba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:16Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f70918-11a4-4762-bf22-1121ba3aea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f70918-11a4-4762-bf22-1121ba3aea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbbcf1d-a8ca-4a09-bca7-73c12e02e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbbcf1d-a8ca-4a09-bca7-73c12e02e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c28c9196-54ba-4c1a-b500-c6b0c836fcba', 'volume_name': 'volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e34292-4e15-4ec7-8b8e-68fd68d6b4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e34292-4e15-4ec7-8b8e-68fd68d6b4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c06b21b-7dd8-4872-8ac8-ee0041c353c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:16 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Volume c28c9196-54ba-4c1a-b500-c6b0c836fcba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba', 'volume_size': 1} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324275752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28c9196-54ba-4c1a-b500-c6b0c836fcba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:16Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Creating volume c28c9196-54ba-4c1a-b500-c6b0c836fcba {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:03:16 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:16 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba 1073741824 Jul 05 20:03:16 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:16 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:03:16 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:16 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.642s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 20:03:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 20:03:17 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba 1073741824" returned: 0 in 0.836s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:17 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba Jul 05 20:03:17 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:17 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba" returned: 0 in 0.633s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:03:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c06b21b-7dd8-4872-8ac8-ee0041c353c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f8d7a2-9392-4805-a98d-140ca81e894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:17 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Volume volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba (c28c9196-54ba-4c1a-b500-c6b0c836fcba): created successfully Jul 05 20:03:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f8d7a2-9392-4805-a98d-140ca81e894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:17 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (a81bfb97-8ec5-4719-bb07-a29ea9836a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:17 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-88e19d69-f033-4f3d-85b9-bd6dce1e7f25 tempest-ProjectReaderTests-1933739378 None] Created volume successfully. Jul 05 20:03:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Creating offline snapshot 9354645a-9f5e-432c-bf2a-8be4c5489fee of volume c28c9196-54ba-4c1a-b500-c6b0c836fcba {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:03:18 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[605559ce-f916-4667-a71e-a1dac1e147a4]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:18 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba Jul 05 20:03:18 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:19 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba" returned: 0 in 0.754s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:19 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee 1G Jul 05 20:03:19 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:19 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee 1G" returned: 0 in 0.774s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:19 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee Jul 05 20:03:19 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:20 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee" returned: 0 in 0.677s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:20 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee is being set with open permissions: ugo+rw Jul 05 20:03:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:20 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee Jul 05 20:03:20 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:21 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee" returned: 0 in 0.635s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:21 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.info Jul 05 20:03:21 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:21 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.info" returned: 0 in 0.647s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:21 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.info is being set with open permissions: ugo+rw Jul 05 20:03:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:21 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.info Jul 05 20:03:21 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:22 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.info" returned: 0 in 0.641s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:22 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6f9fba52-8704-4e93-abf9-afeef0119cbb tempest-ProjectReaderTests-1933739378 None] Create snapshot completed successfully Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-9354645a-9f5e-432c-bf2a-8be4c5489fee-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-9354645a-9f5e-432c-bf2a-8be4c5489fee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-c28c9196-54ba-4c1a-b500-c6b0c836fcba" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-c28c9196-54ba-4c1a-b500-c6b0c836fcba" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-9354645a-9f5e-432c-bf2a-8be4c5489fee" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-9354645a-9f5e-432c-bf2a-8be4c5489fee" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Deleting offline snapshot 9354645a-9f5e-432c-bf2a-8be4c5489fee of volume c28c9196-54ba-4c1a-b500-c6b0c836fcba {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] snapshot_file for this snap is: volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0df7fb-af9a-4fe9-8e87-eeab1d4d087f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:23 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee Jul 05 20:03:23 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:24 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee" returned: 0 in 0.760s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:03:24 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec146f-b0b6-46cd-bffa-f57e9fe0a4f6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:24 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba Jul 05 20:03:24 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:25 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba" returned: 0 in 0.743s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:25 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee Jul 05 20:03:25 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:25 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee" returned: 0 in 0.714s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:25 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee Jul 05 20:03:25 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:26 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba.9354645a-9f5e-432c-bf2a-8be4c5489fee" returned: 0 in 0.647s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-9354645a-9f5e-432c-bf2a-8be4c5489fee" released by "_delete_snapshot" :: held 2.948s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-c28c9196-54ba-4c1a-b500-c6b0c836fcba" released by "delete_snapshot" :: held 2.968s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Created reservations ['392280ff-3061-4c58-b6cc-a7e831992d55', '34ab915a-9ad2-4753-be7f-0fffd96d8dca', '5a5f0275-d575-4e09-87a0-601ff3bd6064', '2f15ebbc-84a9-4b30-a44f-29506274b10d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:03:26 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Delete snapshot completed successfully. Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8ab1630d-b42a-4639-94fa-2c81fe4e4d1b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-9354645a-9f5e-432c-bf2a-8be4c5489fee-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-c28c9196-54ba-4c1a-b500-c6b0c836fcba-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-c28c9196-54ba-4c1a-b500-c6b0c836fcba-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-c28c9196-54ba-4c1a-b500-c6b0c836fcba" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-c28c9196-54ba-4c1a-b500-c6b0c836fcba" acquired by "delete_volume" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d449718-e6d4-4eeb-83a4-2506ff0c5d0a]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:26 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba Jul 05 20:03:26 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:27 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba" returned: 0 in 0.747s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:27 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba Jul 05 20:03:27 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:28 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-c28c9196-54ba-4c1a-b500-c6b0c836fcba" returned: 0 in 0.631s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:28 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-c28c9196-54ba-4c1a-b500-c6b0c836fcba" released by "delete_volume" :: held 1.437s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:28 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Created reservations ['a1481402-cf36-4090-bf9c-b7ff25aa368a', 'd727b626-c24c-4261-8f03-3a8548625288', '1145469e-4d5e-4fad-8202-873163101f63', '20d06f99-53dc-40a4-8ec8-6eb3885be7cc'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:03:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:28 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:28 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:03:28 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:28 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.655s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:03:29 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Deleted volume successfully. Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e973473e-2604-428c-b5b5-3dea07d50bf5 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-c28c9196-54ba-4c1a-b500-c6b0c836fcba-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (28b505d2-deb6-45ef-a196-f09096c4df02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d26e93f-abae-40ea-9c67-8cb632582d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d26e93f-abae-40ea-9c67-8cb632582d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1279144166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c76b572-9510-4a94-967c-a48426c68ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:29Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b003d2b-4099-4465-8778-30967f8b93a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b003d2b-4099-4465-8778-30967f8b93a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c471da76-9080-4cd8-b1df-7501c1a6c7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c471da76-9080-4cd8-b1df-7501c1a6c7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c76b572-9510-4a94-967c-a48426c68ed4', 'volume_name': 'volume-1c76b572-9510-4a94-967c-a48426c68ed4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa16e03-e53c-4201-b247-98a263262d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa16e03-e53c-4201-b247-98a263262d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be232624-7159-4b35-8b51-a4b6fb7eb874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:29 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Volume 1c76b572-9510-4a94-967c-a48426c68ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c76b572-9510-4a94-967c-a48426c68ed4', 'volume_size': 1} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1279144166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c76b572-9510-4a94-967c-a48426c68ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61574355d48d449286a8c5c5d42ab0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:29Z,use_quota=True,user_id='7c5fd9c77269475b8048b63c5752fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Creating volume 1c76b572-9510-4a94-967c-a48426c68ed4 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:03:29 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:03:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:29 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 1073741824 Jul 05 20:03:29 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:30 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 1073741824" returned: 0 in 0.807s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:30 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 Jul 05 20:03:30 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:30 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4" returned: 0 in 0.651s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:03:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be232624-7159-4b35-8b51-a4b6fb7eb874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c76b572-9510-4a94-967c-a48426c68ed4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2b97dc-7b0f-4f35-8262-59f839169b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:30 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Volume volume-1c76b572-9510-4a94-967c-a48426c68ed4 (1c76b572-9510-4a94-967c-a48426c68ed4): created successfully Jul 05 20:03:30 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2b97dc-7b0f-4f35-8262-59f839169b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:31 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Flow 'volume_create_manager' (28b505d2-deb6-45ef-a196-f09096c4df02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:31 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9a659cb7-9b5e-4cad-941e-7a5bdacee5fb tempest-ProjectReaderTests-1933739378 None] Created volume successfully. Jul 05 20:03:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:31 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Creating offline snapshot ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 of volume 1c76b572-9510-4a94-967c-a48426c68ed4 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:03:31 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[56231ffc-10f9-4b5f-b6b5-23818e6d3269]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:31 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 Jul 05 20:03:31 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:32 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4" returned: 0 in 0.766s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:32 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 1G Jul 05 20:03:32 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:33 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 1G" returned: 0 in 0.777s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c76b572-9510-4a94-967c-a48426c68ed4 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:33 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c76b572-9510-4a94-967c-a48426c68ed4 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 Jul 05 20:03:33 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:33 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c76b572-9510-4a94-967c-a48426c68ed4 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4" returned: 0 in 0.667s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:33 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 is being set with open permissions: ugo+rw Jul 05 20:03:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:33 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 Jul 05 20:03:33 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:34 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4" returned: 0 in 0.620s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:34 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.info Jul 05 20:03:34 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:35 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.info" returned: 0 in 0.643s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:35 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.info is being set with open permissions: ugo+rw Jul 05 20:03:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:35 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.info Jul 05 20:03:35 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:35 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.info" returned: 0 in 0.614s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.159s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:35 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-53a90736-dd57-4038-a768-ad4f58d36234 tempest-ProjectReaderTests-1933739378 None] Create snapshot completed successfully Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-ed8815d5-0a8d-427d-85ea-0c1115c4f6b4-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-ed8815d5-0a8d-427d-85ea-0c1115c4f6b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-1c76b572-9510-4a94-967c-a48426c68ed4" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-1c76b572-9510-4a94-967c-a48426c68ed4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-ed8815d5-0a8d-427d-85ea-0c1115c4f6b4" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-ed8815d5-0a8d-427d-85ea-0c1115c4f6b4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Deleting offline snapshot ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 of volume 1c76b572-9510-4a94-967c-a48426c68ed4 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] snapshot_file for this snap is: volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efcc4db-348f-44a8-abf1-3ce089c2af83]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:36 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 Jul 05 20:03:36 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:36 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4" returned: 0 in 0.766s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c76b572-9510-4a94-967c-a48426c68ed4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0a6011-218a-4ee3-bb96-4ffde61f0313]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:37 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 Jul 05 20:03:37 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:37 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4" returned: 0 in 0.742s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:37 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 Jul 05 20:03:37 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:38 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4" returned: 0 in 0.716s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:38 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4 Jul 05 20:03:38 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:39 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4.ed8815d5-0a8d-427d-85ea-0c1115c4f6b4" returned: 0 in 0.676s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-ed8815d5-0a8d-427d-85ea-0c1115c4f6b4" released by "_delete_snapshot" :: held 2.993s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-1c76b572-9510-4a94-967c-a48426c68ed4" released by "delete_snapshot" :: held 3.016s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:39 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Created reservations ['497daa5f-8918-4e05-8f40-d12bb6513432', '1acd7fa9-1ffe-425b-8d9c-bf853f15561d', 'b4a948db-17c5-4e2a-bafe-b3057bdda6c0', 'fff9b658-b524-4604-9ee3-bbfd72f2f394'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:03:39 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Delete snapshot completed successfully. Jul 05 20:03:39 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ee8d0561-0ec9-4d98-98dc-eb42ea56911b tempest-ProjectReaderTests-1933739378 None] Lock "cinder-ed8815d5-0a8d-427d-85ea-0c1115c4f6b4-delete_snapshot" released by "delete_snapshot" :: held 3.143s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-1c76b572-9510-4a94-967c-a48426c68ed4-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-1c76b572-9510-4a94-967c-a48426c68ed4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "cinder-quobyte-1c76b572-9510-4a94-967c-a48426c68ed4" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:40 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-1c76b572-9510-4a94-967c-a48426c68ed4" acquired by "delete_volume" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:40 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9f1b6a-a103-44c1-8cb6-e474c9687aa6]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:40 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 Jul 05 20:03:40 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:41 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4" returned: 0 in 0.759s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:41 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4 Jul 05 20:03:41 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:41 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-1c76b572-9510-4a94-967c-a48426c68ed4" returned: 0 in 0.649s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:41 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-quobyte-1c76b572-9510-4a94-967c-a48426c68ed4" released by "delete_volume" :: held 1.464s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:41 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Created reservations ['1d619f07-a525-4c8a-8dec-a11228844da7', '6d767c2e-88d6-4ab6-8b6a-1440515d6002', 'e5411283-2fdb-47bc-a665-8b5784cb6003', 'bee7fd10-80af-4469-8d39-79581937d4a6'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:03:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:42 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:42 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:03:42 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:42 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.629s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:42 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:03:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Deleted volume successfully. Jul 05 20:03:42 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-f85568ee-5d14-40d1-a6d7-b32e60a40a52 tempest-ProjectReaderTests-1933739378 None] Lock "cinder-1c76b572-9510-4a94-967c-a48426c68ed4-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Flow 'volume_create_manager' (37d4f78e-d59d-4eec-821a-fb041655593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f94968-cc1b-439e-9dc9-acc6f61df0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f94968-cc1b-439e-9dc9-acc6f61df0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335392132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f09f43c-acfa-483b-b593-eb0aab982aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6a88c943a041db90b0fd0ae4494a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:46Z,use_quota=True,user_id='2e823726085b46f89f02d821c606283a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1e396e-b8e9-43c4-9f8a-981946ec14a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1e396e-b8e9-43c4-9f8a-981946ec14a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d975488-651b-41b1-a9a2-c05566af14ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d975488-651b-41b1-a9a2-c05566af14ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f09f43c-acfa-483b-b593-eb0aab982aac', 'volume_name': 'volume-7f09f43c-acfa-483b-b593-eb0aab982aac', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcd590c-9f11-4e91-bc37-174ef0e781eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcd590c-9f11-4e91-bc37-174ef0e781eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9270d501-bff4-43f2-bc9d-7161dad620a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:46 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Volume 7f09f43c-acfa-483b-b593-eb0aab982aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f09f43c-acfa-483b-b593-eb0aab982aac', 'volume_size': 1} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335392132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f09f43c-acfa-483b-b593-eb0aab982aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6a88c943a041db90b0fd0ae4494a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:46Z,use_quota=True,user_id='2e823726085b46f89f02d821c606283a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Creating volume 7f09f43c-acfa-483b-b593-eb0aab982aac {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:03:46 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:03:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:46 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac 1073741824 Jul 05 20:03:46 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:47 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac 1073741824" returned: 0 in 0.805s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:47 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac Jul 05 20:03:47 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:47 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac" returned: 0 in 0.654s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:47 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:03:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9270d501-bff4-43f2-bc9d-7161dad620a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f09f43c-acfa-483b-b593-eb0aab982aac', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f061358e-3e9d-4864-966d-83e37b12a133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:47 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Volume volume-7f09f43c-acfa-483b-b593-eb0aab982aac (7f09f43c-acfa-483b-b593-eb0aab982aac): created successfully Jul 05 20:03:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f061358e-3e9d-4864-966d-83e37b12a133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:47 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Flow 'volume_create_manager' (37d4f78e-d59d-4eec-821a-fb041655593f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-680e4ccb-a90a-4a85-b825-720429d23f2a tempest-ProjectReaderTests-742694682 None] Created volume successfully. Jul 05 20:03:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Acquiring lock "cinder-7f09f43c-acfa-483b-b593-eb0aab982aac-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Lock "cinder-7f09f43c-acfa-483b-b593-eb0aab982aac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Acquiring lock "cinder-quobyte-7f09f43c-acfa-483b-b593-eb0aab982aac" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Lock "cinder-quobyte-7f09f43c-acfa-483b-b593-eb0aab982aac" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:48 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8864ea8-8f0e-4289-80dd-b3ecc5f6c964]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:48 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac Jul 05 20:03:48 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:49 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac" returned: 0 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:49 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac Jul 05 20:03:49 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:49 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-7f09f43c-acfa-483b-b593-eb0aab982aac" returned: 0 in 0.636s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Lock "cinder-quobyte-7f09f43c-acfa-483b-b593-eb0aab982aac" released by "delete_volume" :: held 1.422s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=45,cinder:UPDATE=58,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Created reservations ['5042848e-fc19-49ce-89ab-ac783a7ac629', '48d29b00-8dc4-48af-b21c-2f31f3c24f98', 'bb7bccb5-8745-4062-bd36-5403140f8ab4', 'ba1df325-4dfe-405b-a6a4-af4e650915b7'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:49 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:03:49 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:50 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.644s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:03:50 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Deleted volume successfully. Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-1cad6e53-d069-4a24-8be9-ee94fee03796 tempest-ProjectReaderTests-742694682 None] Lock "cinder-7f09f43c-acfa-483b-b593-eb0aab982aac-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (95e6a72f-9af2-44e3-92f6-df6a62b3d35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8dc219-c1a0-46e6-90b2-4b6242778fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8dc219-c1a0-46e6-90b2-4b6242778fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001910943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1a8f34-5781-4bb5-abd8-e42ddcf3f880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:51Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34db0586-6225-47c2-987a-2a3fddba64d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34db0586-6225-47c2-987a-2a3fddba64d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8dd4c7-ecc3-4f3e-be55-a4632734f94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8dd4c7-ecc3-4f3e-be55-a4632734f94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1a8f34-5781-4bb5-abd8-e42ddcf3f880', 'volume_name': 'volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f96c8f-7f28-422a-b5ae-3b8fdb51d768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f96c8f-7f28-422a-b5ae-3b8fdb51d768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c79888-0d10-48ac-8a3c-d0125fc186d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:50 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Volume 8a1a8f34-5781-4bb5-abd8-e42ddcf3f880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880', 'volume_size': 1} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001910943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1a8f34-5781-4bb5-abd8-e42ddcf3f880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:51Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Creating volume 8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:03:50 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:03:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:50 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 1073741824 Jul 05 20:03:50 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Flow 'volume_create_manager' (593c6633-b5eb-403d-92bd-432f873a3207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec46f40-4c62-4bbe-844d-a234310468d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec46f40-4c62-4bbe-844d-a234310468d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23781730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300c83ae-cdfd-49b4-9d26-3be5cd3826f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6a88c943a041db90b0fd0ae4494a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:51Z,use_quota=True,user_id='2e823726085b46f89f02d821c606283a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7f99ac-e4c2-4014-8160-c9757f14a8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7f99ac-e4c2-4014-8160-c9757f14a8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5872196-1c55-4120-b065-9021ffbf1590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5872196-1c55-4120-b065-9021ffbf1590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300c83ae-cdfd-49b4-9d26-3be5cd3826f3', 'volume_name': 'volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95baa76-35f3-46ca-a72d-c6e0e4bf10b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95baa76-35f3-46ca-a72d-c6e0e4bf10b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e221f88-08cf-41d1-a8fc-385719540ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:51 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Volume 300c83ae-cdfd-49b4-9d26-3be5cd3826f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3', 'volume_size': 1} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:51 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 1073741824" returned: 0 in 0.825s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:51 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 Jul 05 20:03:51 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:52 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" returned: 0 in 0.644s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.238s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23781730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300c83ae-cdfd-49b4-9d26-3be5cd3826f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6a88c943a041db90b0fd0ae4494a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:03:51Z,use_quota=True,user_id='2e823726085b46f89f02d821c606283a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Creating volume 300c83ae-cdfd-49b4-9d26-3be5cd3826f3 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:03:52 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c79888-0d10-48ac-8a3c-d0125fc186d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5cb275-1aa6-4c3b-ab92-5f812a846b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:52 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 1073741824 Jul 05 20:03:52 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:52 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Volume volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 (8a1a8f34-5781-4bb5-abd8-e42ddcf3f880): created successfully Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5cb275-1aa6-4c3b-ab92-5f812a846b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (95e6a72f-9af2-44e3-92f6-df6a62b3d35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:52 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2f3bfceb-71e2-4be9-beaa-9686efbbebc4 tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 20:03:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:53 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 1073741824" returned: 0 in 0.831s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:53 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 Jul 05 20:03:53 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:53 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3" returned: 0 in 0.645s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.911s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e221f88-08cf-41d1-a8fc-385719540ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb063fe1-b900-4937-8383-745e14301bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Creating offline snapshot bb89b6c7-7ac6-4ca1-9688-2df4b9849448 of volume 8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:03:53 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Volume volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 (300c83ae-cdfd-49b4-9d26-3be5cd3826f3): created successfully Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb063fe1-b900-4937-8383-745e14301bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Flow 'volume_create_manager' (593c6633-b5eb-403d-92bd-432f873a3207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ef72de-653f-403c-9518-3194c7f08ddf]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:53 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4d52257b-38a6-456d-92e6-02fbd93eee80 tempest-ProjectReaderTests-742694682 None] Created volume successfully. Jul 05 20:03:54 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 Jul 05 20:03:54 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Acquiring lock "cinder-300c83ae-cdfd-49b4-9d26-3be5cd3826f3-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Lock "cinder-300c83ae-cdfd-49b4-9d26-3be5cd3826f3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Acquiring lock "cinder-quobyte-300c83ae-cdfd-49b4-9d26-3be5cd3826f3" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:54 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Lock "cinder-quobyte-300c83ae-cdfd-49b4-9d26-3be5cd3826f3" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:54 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da84b08-d59a-4625-bbe5-4ec1c73d2272]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:54 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 Jul 05 20:03:54 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:54 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" returned: 0 in 0.767s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:54 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 1G Jul 05 20:03:54 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:55 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3" returned: 0 in 0.782s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:55 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3 Jul 05 20:03:55 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:55 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 1G" returned: 0 in 0.831s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:55 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 Jul 05 20:03:55 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:55 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-300c83ae-cdfd-49b4-9d26-3be5cd3826f3" returned: 0 in 0.658s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Lock "cinder-quobyte-300c83ae-cdfd-49b4-9d26-3be5cd3826f3" released by "delete_volume" :: held 1.483s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Created reservations ['c9d11d97-bc97-47b3-b6c0-d10db81220c8', 'a414a034-c194-436f-9335-3e3249f12916', 'b80c7c9f-5c35-4316-809b-cabc288bef22', '57b3e6d0-afc9-41d5-b57c-4fefbe5c0d86'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:55 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:03:55 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:56 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448" returned: 0 in 0.735s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:56 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 is being set with open permissions: ugo+rw Jul 05 20:03:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:56 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 Jul 05 20:03:56 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:56 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.717s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:56 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:03:56 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Deleted volume successfully. Jul 05 20:03:56 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ef5a8a7a-edba-49e4-9832-a7d7ba995693 tempest-ProjectReaderTests-742694682 None] Lock "cinder-300c83ae-cdfd-49b4-9d26-3be5cd3826f3-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:03:56 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448" returned: 0 in 0.697s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:57 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.info Jul 05 20:03:57 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:57 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.info" returned: 0 in 0.686s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:57 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.info is being set with open permissions: ugo+rw Jul 05 20:03:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:57 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.info Jul 05 20:03:57 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:03:58 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 05 20:03:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.info" returned: 0 in 0.698s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:03:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.519s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:03:58 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-44269a54-d809-405e-b153-ff7499e395d4 tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-bb89b6c7-7ac6-4ca1-9688-2df4b9849448-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Lock "cinder-bb89b6c7-7ac6-4ca1-9688-2df4b9849448-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-bb89b6c7-7ac6-4ca1-9688-2df4b9849448" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-bb89b6c7-7ac6-4ca1-9688-2df4b9849448" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Deleting offline snapshot bb89b6c7-7ac6-4ca1-9688-2df4b9849448 of volume 8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] snapshot_file for this snap is: volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[607db279-29ab-4ead-9279-bbc271f060ca]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:03:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:03:59 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 Jul 05 20:03:59 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:00 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448" returned: 0 in 0.780s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b22294f-4906-4b47-a26b-e2770a426994]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:SELECT=63,cinder:UPDATE=82,cinder:INSERT=21,cinder:DELETE=9 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:04:00 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 Jul 05 20:04:00 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Flow 'volume_create_manager' (9ee0d982-dc89-4d0d-a697-1001fbe662d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04daf3c-6516-46e6-a83b-5231cd27a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04daf3c-6516-46e6-a83b-5231cd27a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332313836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ea009e-31e0-4c29-aadf-1b8104ccf571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328452455dda45f4825aa05047602b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:00Z,use_quota=True,user_id='d00457cce33c488c88637d30e8207dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cee559-901b-4eae-9dc5-056acbc7cf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cee559-901b-4eae-9dc5-056acbc7cf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ca87d1-c16f-442f-b94c-6efb113f888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ca87d1-c16f-442f-b94c-6efb113f888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ea009e-31e0-4c29-aadf-1b8104ccf571', 'volume_name': 'volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc1cccf-1893-408d-92e4-6c334125f4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc1cccf-1893-408d-92e4-6c334125f4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273dd429-f16d-4c20-bb20-e5fd2a67a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:00 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Volume b9ea009e-31e0-4c29-aadf-1b8104ccf571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571', 'volume_size': 1} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332313836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ea009e-31e0-4c29-aadf-1b8104ccf571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328452455dda45f4825aa05047602b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:00Z,use_quota=True,user_id='d00457cce33c488c88637d30e8207dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Creating volume b9ea009e-31e0-4c29-aadf-1b8104ccf571 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:04:00 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:00 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 1073741824 Jul 05 20:04:00 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:00 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" returned: 0 in 0.800s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:00 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 Jul 05 20:04:01 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:01 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 1073741824" returned: 0 in 0.836s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:01 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 Jul 05 20:04:01 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:01 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448" returned: 0 in 0.762s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:01 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448 Jul 05 20:04:01 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:01 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571" returned: 0 in 0.644s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273dd429-f16d-4c20-bb20-e5fd2a67a60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f46ceee-185b-49a5-97b1-f8035d9c88ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:01 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Volume volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 (b9ea009e-31e0-4c29-aadf-1b8104ccf571): created successfully Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f46ceee-185b-49a5-97b1-f8035d9c88ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:01 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Flow 'volume_create_manager' (9ee0d982-dc89-4d0d-a697-1001fbe662d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:01 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fffeb511-45e8-48b1-b1a1-f9cddbf86451 tempest-ProjectReaderTests-1633139093 None] Created volume successfully. Jul 05 20:04:02 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880.bb89b6c7-7ac6-4ca1-9688-2df4b9849448" returned: 0 in 0.650s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-bb89b6c7-7ac6-4ca1-9688-2df4b9849448" released by "_delete_snapshot" :: held 3.092s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" released by "delete_snapshot" :: held 3.114s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Acquiring lock "cinder-b9ea009e-31e0-4c29-aadf-1b8104ccf571-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Lock "cinder-b9ea009e-31e0-4c29-aadf-1b8104ccf571-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Created reservations ['c88c621a-46e7-4235-a0eb-9928762416d6', '98faff38-9759-4bdf-9cf6-7feefdf93569', '2a53de79-346d-4dc3-a587-aefc5ba93d1e', '4f4a1154-c376-4487-8cc4-07f8691dd443'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Acquiring lock "cinder-quobyte-b9ea009e-31e0-4c29-aadf-1b8104ccf571" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Lock "cinder-quobyte-b9ea009e-31e0-4c29-aadf-1b8104ccf571" acquired by "delete_volume" :: waited 0.021s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[128d4052-3d8d-4fcf-af93-a8bb5e6e4267]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:02 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Delete snapshot completed successfully. Jul 05 20:04:02 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fb86d168-e69d-4da5-bf05-7d001e5cc82f tempest-ProjectMemberTests-127409771 None] Lock "cinder-bb89b6c7-7ac6-4ca1-9688-2df4b9849448-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:02 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 Jul 05 20:04:02 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:03 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571" returned: 0 in 0.754s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:03 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571 Jul 05 20:04:03 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Lock "cinder-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fecf07-4e6c-4649-8645-0c0602b56d1e]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:03 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 Jul 05 20:04:03 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:03 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-b9ea009e-31e0-4c29-aadf-1b8104ccf571" returned: 0 in 0.645s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Lock "cinder-quobyte-b9ea009e-31e0-4c29-aadf-1b8104ccf571" released by "delete_volume" :: held 1.441s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Created reservations ['1336bace-8aff-463c-a4de-e2d794120680', '0e44d959-e4f9-4e6d-a51f-89f73a822cb9', 'f48de3fe-3e44-44e3-bc8b-dea9caa09341', '4a8ea7f6-566a-438c-9f2a-45fc26eb36fd'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:04 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:04:04 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:04 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" returned: 0 in 0.758s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:04 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880 Jul 05 20:04:04 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:04 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.660s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:04:04 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Deleted volume successfully. Jul 05 20:04:04 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-8915cd7a-6128-46ea-ba94-ea2580e7037b tempest-ProjectReaderTests-1633139093 None] Lock "cinder-b9ea009e-31e0-4c29-aadf-1b8104ccf571-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:05 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" returned: 0 in 0.653s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880" released by "delete_volume" :: held 1.471s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Created reservations ['429fc537-0b27-477d-bfc0-fb2d50574be2', 'f514dd31-a511-41cd-a2ea-01faa043d271', 'ca27681b-5bbe-4bdc-8134-1603d37c57de', '1efddbb6-b450-4e7e-b00d-4ec78417429d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Flow 'volume_create_manager' (4686e3c0-0846-45fa-bf6a-2631e7c51d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76283bf-d0a2-4b52-997f-aec736574640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76283bf-d0a2-4b52-997f-aec736574640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312823659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4a7ca9-e248-4310-bb1b-b5e86759df2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328452455dda45f4825aa05047602b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:05Z,use_quota=True,user_id='d00457cce33c488c88637d30e8207dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e860477b-3fa6-4123-852a-72bd47763522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e860477b-3fa6-4123-852a-72bd47763522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73812878-d126-4fd9-be69-8d24fbe7a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73812878-d126-4fd9-be69-8d24fbe7a9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4a7ca9-e248-4310-bb1b-b5e86759df2e', 'volume_name': 'volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c69fa31-54b8-4a2f-a067-eb18c0cd5dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c69fa31-54b8-4a2f-a067-eb18c0cd5dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca186db1-8823-4281-9599-e814f3785a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:05 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Volume ce4a7ca9-e248-4310-bb1b-b5e86759df2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e', 'volume_size': 1} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312823659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4a7ca9-e248-4310-bb1b-b5e86759df2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328452455dda45f4825aa05047602b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:05Z,use_quota=True,user_id='d00457cce33c488c88637d30e8207dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Creating volume ce4a7ca9-e248-4310-bb1b-b5e86759df2e {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:04:05 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:05 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e 1073741824 Jul 05 20:04:05 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:05 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:05 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:04:05 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:06 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.704s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:04:06 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Deleted volume successfully. Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-3147a1c9-818c-4273-af2f-cf4d0e3b0f75 tempest-ProjectMemberTests-127409771 None] Lock "cinder-8a1a8f34-5781-4bb5-abd8-e42ddcf3f880-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:06 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e 1073741824" returned: 0 in 0.993s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:06 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e Jul 05 20:04:06 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (163ebc17-f908-4ed2-bd14-9146d9bed058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3875ab37-bde7-414b-899e-82f12e766994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3875ab37-bde7-414b-899e-82f12e766994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156526623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bed7c9-789b-4cb9-88f2-76e6da2cd334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:06Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdb1c30-16ff-4010-b32a-09f4fd981189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdb1c30-16ff-4010-b32a-09f4fd981189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5ad34f-3d39-49b5-b97b-deb66c23fec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5ad34f-3d39-49b5-b97b-deb66c23fec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83bed7c9-789b-4cb9-88f2-76e6da2cd334', 'volume_name': 'volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183e2eb4-e5d5-4ecf-8847-ff2e68e49895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183e2eb4-e5d5-4ecf-8847-ff2e68e49895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c37461-f796-4ecc-8358-b6e8570fc32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:06 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Volume 83bed7c9-789b-4cb9-88f2-76e6da2cd334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334', 'volume_size': 1} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:06 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e" returned: 0 in 0.636s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156526623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bed7c9-789b-4cb9-88f2-76e6da2cd334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:06Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Creating volume 83bed7c9-789b-4cb9-88f2-76e6da2cd334 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:04:06 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:06 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 1073741824 Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca186db1-8823-4281-9599-e814f3785a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:06 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0397f59-e676-43bb-8bbe-fe0d257ce081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:06 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Volume volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e (ce4a7ca9-e248-4310-bb1b-b5e86759df2e): created successfully Jul 05 20:04:06 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0397f59-e676-43bb-8bbe-fe0d257ce081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:07 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Flow 'volume_create_manager' (4686e3c0-0846-45fa-bf6a-2631e7c51d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:07 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-24a15835-6717-45fc-9fd9-e6ae7c3dab93 tempest-ProjectReaderTests-1633139093 None] Created volume successfully. Jul 05 20:04:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Acquiring lock "cinder-ce4a7ca9-e248-4310-bb1b-b5e86759df2e-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Lock "cinder-ce4a7ca9-e248-4310-bb1b-b5e86759df2e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Acquiring lock "cinder-quobyte-ce4a7ca9-e248-4310-bb1b-b5e86759df2e" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:07 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Lock "cinder-quobyte-ce4a7ca9-e248-4310-bb1b-b5e86759df2e" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:07 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55cf01-67b4-4710-9897-f34dd54620cb]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:07 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e Jul 05 20:04:07 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:07 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 1073741824" returned: 0 in 0.826s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:07 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:07 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 Jul 05 20:04:07 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:08 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e" returned: 0 in 0.772s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:08 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e Jul 05 20:04:08 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:08 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334" returned: 0 in 0.667s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c37461-f796-4ecc-8358-b6e8570fc32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6546d018-6468-4577-926d-bbbb32e3a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:08 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Volume volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 (83bed7c9-789b-4cb9-88f2-76e6da2cd334): created successfully Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6546d018-6468-4577-926d-bbbb32e3a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (163ebc17-f908-4ed2-bd14-9146d9bed058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:08 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-d754eb1d-bd27-4827-b53e-ee4d5b123605 tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 20:04:08 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ce4a7ca9-e248-4310-bb1b-b5e86759df2e" returned: 0 in 0.657s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Lock "cinder-quobyte-ce4a7ca9-e248-4310-bb1b-b5e86759df2e" released by "delete_volume" :: held 1.464s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Created reservations ['b79b4bc3-9324-4553-adb4-2edaf07bc232', '2dd083c9-850a-436d-8fe5-5b8780c6349b', 'c2f096ff-de57-4a57-a598-6f0b3f28c53d', '869a209c-f2a7-4362-8d97-02cad35a94ee'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:08 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:08 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:04:09 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:09 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.692s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:09 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:04:09 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Creating offline snapshot 82a1f8ae-a813-4687-b1f3-196fe599b1a9 of volume 83bed7c9-789b-4cb9-88f2-76e6da2cd334 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:04:09 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Deleted volume successfully. Jul 05 20:04:09 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a854e-3e7d-4408-9ade-6c25ddc9f607]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:09 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:09 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9910ce99-8def-4634-93b8-7fdebd0019af tempest-ProjectReaderTests-1633139093 None] Lock "cinder-ce4a7ca9-e248-4310-bb1b-b5e86759df2e-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:09 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 Jul 05 20:04:09 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Flow 'volume_create_manager' (229c010c-1882-457a-b40c-6b7f3ebda9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db4b145-3d26-4c1a-b0c5-86a208a841e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db4b145-3d26-4c1a-b0c5-86a208a841e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1898855763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afefbbc-d213-49d8-aee8-4e37384665a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328452455dda45f4825aa05047602b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:10Z,use_quota=True,user_id='d00457cce33c488c88637d30e8207dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86330573-456c-4184-b201-e7d952ab3ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86330573-456c-4184-b201-e7d952ab3ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f667be-0e9a-405f-b317-9778bb086693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f667be-0e9a-405f-b317-9778bb086693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2afefbbc-d213-49d8-aee8-4e37384665a4', 'volume_name': 'volume-2afefbbc-d213-49d8-aee8-4e37384665a4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc34574-99ae-4a2a-8ef8-8c62bb15a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc34574-99ae-4a2a-8ef8-8c62bb15a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d5e20e-8ba0-4c8c-8579-9eb6cc467cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:10 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Volume 2afefbbc-d213-49d8-aee8-4e37384665a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2afefbbc-d213-49d8-aee8-4e37384665a4', 'volume_size': 1} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:10 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334" returned: 0 in 0.778s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:10 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 1G Jul 05 20:04:10 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:11 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 1G" returned: 0 in 0.773s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:11 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 Jul 05 20:04:11 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:11 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9" returned: 0 in 0.679s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:11 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 is being set with open permissions: ugo+rw Jul 05 20:04:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:11 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 Jul 05 20:04:11 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:12 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9" returned: 0 in 0.642s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:12 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.info Jul 05 20:04:12 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:13 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.info" returned: 0 in 0.643s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:13 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.info is being set with open permissions: ugo+rw Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:13 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.info Jul 05 20:04:13 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:13 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.info" returned: 0 in 0.640s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.242s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.755s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1898855763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afefbbc-d213-49d8-aee8-4e37384665a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328452455dda45f4825aa05047602b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:10Z,use_quota=True,user_id='d00457cce33c488c88637d30e8207dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Creating volume 2afefbbc-d213-49d8-aee8-4e37384665a4 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:04:13 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:04:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:13 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4 1073741824 Jul 05 20:04:13 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:13 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-27c9dcca-24d2-49dd-a4ae-d4912e086e65 tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 20:04:14 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4 1073741824" returned: 0 in 0.815s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:14 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4 Jul 05 20:04:14 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-82a1f8ae-a813-4687-b1f3-196fe599b1a9-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Lock "cinder-82a1f8ae-a813-4687-b1f3-196fe599b1a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-83bed7c9-789b-4cb9-88f2-76e6da2cd334" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-83bed7c9-789b-4cb9-88f2-76e6da2cd334" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-82a1f8ae-a813-4687-b1f3-196fe599b1a9" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-82a1f8ae-a813-4687-b1f3-196fe599b1a9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Deleting offline snapshot 82a1f8ae-a813-4687-b1f3-196fe599b1a9 of volume 83bed7c9-789b-4cb9-88f2-76e6da2cd334 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] snapshot_file for this snap is: volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfb3ea4-1099-4fab-9230-eb09c66fe7be]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:15 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 Jul 05 20:04:15 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:15 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4" returned: 0 in 0.668s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d5e20e-8ba0-4c8c-8579-9eb6cc467cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afefbbc-d213-49d8-aee8-4e37384665a4', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce94c92-daa3-490f-8183-b716458c8103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:15 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Volume volume-2afefbbc-d213-49d8-aee8-4e37384665a4 (2afefbbc-d213-49d8-aee8-4e37384665a4): created successfully Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce94c92-daa3-490f-8183-b716458c8103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Flow 'volume_create_manager' (229c010c-1882-457a-b40c-6b7f3ebda9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:15 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-c17b9c66-53b6-4463-830b-5f41f7e890e1 tempest-ProjectReaderTests-1633139093 None] Created volume successfully. Jul 05 20:04:15 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9" returned: 0 in 0.784s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[567e8796-3cbf-41b8-ae17-c8540fa9f9ae]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:15 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:16 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 Jul 05 20:04:16 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:16 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:04:16 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Acquiring lock "cinder-2afefbbc-d213-49d8-aee8-4e37384665a4-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Lock "cinder-2afefbbc-d213-49d8-aee8-4e37384665a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Acquiring lock "cinder-quobyte-2afefbbc-d213-49d8-aee8-4e37384665a4" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Lock "cinder-quobyte-2afefbbc-d213-49d8-aee8-4e37384665a4" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d76619d-1604-4019-89ad-cd1041141c41]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:16 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4 Jul 05 20:04:16 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:16 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334" returned: 0 in 0.852s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:16 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 Jul 05 20:04:16 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:16 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.711s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 20:04:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 20:04:17 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4" returned: 0 in 0.805s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:17 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4 Jul 05 20:04:17 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:17 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9" returned: 0 in 0.794s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:17 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9 Jul 05 20:04:17 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:17 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-2afefbbc-d213-49d8-aee8-4e37384665a4" returned: 0 in 0.654s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Lock "cinder-quobyte-2afefbbc-d213-49d8-aee8-4e37384665a4" released by "delete_volume" :: held 1.504s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Created reservations ['91f0bdcd-9555-46eb-a4f1-cf3461574395', '69306bea-96e2-4da0-a72a-bbb20f7902cd', 'dfa51e0c-0188-4d27-87ff-b9bf29124eb2', 'c367a406-3824-4bd2-8b94-8e70fa305d68'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:18 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:04:18 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:18 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334.82a1f8ae-a813-4687-b1f3-196fe599b1a9" returned: 0 in 0.654s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-82a1f8ae-a813-4687-b1f3-196fe599b1a9" released by "_delete_snapshot" :: held 3.182s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-83bed7c9-789b-4cb9-88f2-76e6da2cd334" released by "delete_snapshot" :: held 3.204s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Created reservations ['f607f751-cd9f-4d78-9f0a-71d622b9ca81', 'ffb72337-033b-43aa-b888-35720e66968a', 'fec2559a-627e-4d90-a83b-a94ce4f84670', '4b16d8ac-b70d-46ae-8a29-ecc7dc0d2ecb'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:18 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Delete snapshot completed successfully. Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-191d5a14-7a87-48aa-9849-11db14465331 tempest-ProjectMemberTests-127409771 None] Lock "cinder-82a1f8ae-a813-4687-b1f3-196fe599b1a9-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:18 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.691s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:04:18 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Deleted volume successfully. Jul 05 20:04:18 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-467cdc46-ac3c-4320-93aa-eaf9addca76a tempest-ProjectReaderTests-1633139093 None] Lock "cinder-2afefbbc-d213-49d8-aee8-4e37384665a4-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Flow 'volume_create_manager' (3bf5750b-901b-440e-b3e0-c02a4170697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5162007e-fccf-470a-ab73-b7d2882575f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5162007e-fccf-470a-ab73-b7d2882575f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269601660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6f57ef-1910-41b1-a05e-b64be7d47e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328452455dda45f4825aa05047602b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:19Z,use_quota=True,user_id='d00457cce33c488c88637d30e8207dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f547bf-9ddc-487a-ab6b-9db5342fbae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f547bf-9ddc-487a-ab6b-9db5342fbae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e359ac0-8a9f-40f4-9b06-c8337286be72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e359ac0-8a9f-40f4-9b06-c8337286be72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6f57ef-1910-41b1-a05e-b64be7d47e91', 'volume_name': 'volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae2cd18-7e2a-4261-8bee-07604a369875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae2cd18-7e2a-4261-8bee-07604a369875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cfc41d-7f1f-4f12-abc9-a24ef0a952a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:19 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Volume ef6f57ef-1910-41b1-a05e-b64be7d47e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91', 'volume_size': 1} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269601660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6f57ef-1910-41b1-a05e-b64be7d47e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328452455dda45f4825aa05047602b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:19Z,use_quota=True,user_id='d00457cce33c488c88637d30e8207dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Creating volume ef6f57ef-1910-41b1-a05e-b64be7d47e91 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:04:19 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:19 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 1073741824 Jul 05 20:04:19 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-83bed7c9-789b-4cb9-88f2-76e6da2cd334-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Lock "cinder-83bed7c9-789b-4cb9-88f2-76e6da2cd334-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-83bed7c9-789b-4cb9-88f2-76e6da2cd334" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-83bed7c9-789b-4cb9-88f2-76e6da2cd334" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fa1036-b867-43bd-8a1e-8448bca3824d]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:19 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:19 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 Jul 05 20:04:19 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:20 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 1073741824" returned: 0 in 0.859s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:20 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 Jul 05 20:04:20 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:20 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334" returned: 0 in 0.812s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:20 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334 Jul 05 20:04:20 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:20 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91" returned: 0 in 0.658s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cfc41d-7f1f-4f12-abc9-a24ef0a952a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482c3ac0-8c04-424d-959d-47247204ab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:20 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Volume volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 (ef6f57ef-1910-41b1-a05e-b64be7d47e91): created successfully Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482c3ac0-8c04-424d-959d-47247204ab69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Flow 'volume_create_manager' (3bf5750b-901b-440e-b3e0-c02a4170697e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:20 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0011dd4d-96de-4111-99ca-ff315b23116a tempest-ProjectReaderTests-1633139093 None] Created volume successfully. Jul 05 20:04:20 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-83bed7c9-789b-4cb9-88f2-76e6da2cd334" returned: 0 in 0.646s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-83bed7c9-789b-4cb9-88f2-76e6da2cd334" released by "delete_volume" :: held 1.517s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Created reservations ['516bb5f0-753e-4e2e-b914-954d99407fe8', '97c1d0d6-e2f7-436e-aedb-dd1016e6b587', '0733470e-1220-443c-8730-70b4b64e3b79', '5dd0b606-c4a8-4c0c-96dd-fdca5ae9376b'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:20 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:20 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:04:20 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Acquiring lock "cinder-ef6f57ef-1910-41b1-a05e-b64be7d47e91-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Lock "cinder-ef6f57ef-1910-41b1-a05e-b64be7d47e91-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Acquiring lock "cinder-quobyte-ef6f57ef-1910-41b1-a05e-b64be7d47e91" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Lock "cinder-quobyte-ef6f57ef-1910-41b1-a05e-b64be7d47e91" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c75545c-c650-4192-9a86-e59001b6a7e7]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:21 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 Jul 05 20:04:21 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:21 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.651s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:04:21 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Deleted volume successfully. Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-fdf247b8-6daa-4699-9384-eb5aefcb7b4b tempest-ProjectMemberTests-127409771 None] Lock "cinder-83bed7c9-789b-4cb9-88f2-76e6da2cd334-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (b95ecf4e-5587-4e3d-8119-c53e6e88cc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:21 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4e60eb-0358-425b-a514-ea7f5a62f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4e60eb-0358-425b-a514-ea7f5a62f92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-544538458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fdb748-9b30-4bac-9580-633565937905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:22Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090ed7c4-c81a-4498-a46f-7709396b1508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090ed7c4-c81a-4498-a46f-7709396b1508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623584c2-3e7d-488e-bcae-680675b03bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623584c2-3e7d-488e-bcae-680675b03bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06fdb748-9b30-4bac-9580-633565937905', 'volume_name': 'volume-06fdb748-9b30-4bac-9580-633565937905', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6d19e4-7c7f-4f84-af28-1cc64e581d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6d19e4-7c7f-4f84-af28-1cc64e581d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94744249-bad0-4310-b265-6ec8554c8fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:22 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Volume 06fdb748-9b30-4bac-9580-633565937905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06fdb748-9b30-4bac-9580-633565937905', 'volume_size': 1} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-544538458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fdb748-9b30-4bac-9580-633565937905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:22Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Creating volume 06fdb748-9b30-4bac-9580-633565937905 {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:04:22 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:22 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91" returned: 0 in 0.819s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:22 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 1073741824 Jul 05 20:04:22 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:22 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91 Jul 05 20:04:22 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:22 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-ef6f57ef-1910-41b1-a05e-b64be7d47e91" returned: 0 in 0.679s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Lock "cinder-quobyte-ef6f57ef-1910-41b1-a05e-b64be7d47e91" released by "delete_volume" :: held 1.537s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Created reservations ['a423f079-c544-431a-9833-4c4d80662a94', 'a6e1069f-be5e-4ffe-acad-bf5be8a88d88', 'b1e44439-007a-497a-a106-f565479a94d8', '167842b4-2003-49eb-a7ad-263d7dfa5db5'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:22 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 1073741824" returned: 0 in 0.843s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:22 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:04:22 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:22 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:22 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 Jul 05 20:04:22 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:23 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.684s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:04:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Deleted volume successfully. Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-477cc527-48db-48a6-a447-9d0a50930a89 tempest-ProjectReaderTests-1633139093 None] Lock "cinder-ef6f57ef-1910-41b1-a05e-b64be7d47e91-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:23 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905" returned: 0 in 0.688s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94744249-bad0-4310-b265-6ec8554c8fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06fdb748-9b30-4bac-9580-633565937905', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d92b66b-7e81-4d22-95eb-36702adaabd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:23 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Volume volume-06fdb748-9b30-4bac-9580-633565937905 (06fdb748-9b30-4bac-9580-633565937905): created successfully Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d92b66b-7e81-4d22-95eb-36702adaabd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:23 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (b95ecf4e-5587-4e3d-8119-c53e6e88cc8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:23 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-99003ca0-4616-4c87-b258-a8b51863076a tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 20:04:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:24 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Creating offline snapshot fdaecf7c-1588-4659-b27f-1119c962d023 of volume 06fdb748-9b30-4bac-9580-633565937905 {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:04:24 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c315f110-7abb-4e23-ba50-e298e89b885f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:24 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:24 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 Jul 05 20:04:24 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:25 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905" returned: 0 in 0.793s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:25 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 1G Jul 05 20:04:25 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:25 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 1G" returned: 0 in 0.782s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:25 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06fdb748-9b30-4bac-9580-633565937905 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:25 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06fdb748-9b30-4bac-9580-633565937905 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 Jul 05 20:04:25 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:26 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06fdb748-9b30-4bac-9580-633565937905 -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023" returned: 0 in 0.676s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:26 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 is being set with open permissions: ugo+rw Jul 05 20:04:26 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:26 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 Jul 05 20:04:26 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:27 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023" returned: 0 in 0.647s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:27 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.info Jul 05 20:04:27 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:27 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.info" returned: 0 in 0.643s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:27 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.info is being set with open permissions: ugo+rw Jul 05 20:04:27 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:27 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.info Jul 05 20:04:27 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:28 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.info" returned: 0 in 0.631s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:28 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.255s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:28 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2e55acff-e508-459c-a61a-efcaf235b2a7 tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-fdaecf7c-1588-4659-b27f-1119c962d023-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Lock "cinder-fdaecf7c-1588-4659-b27f-1119c962d023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-06fdb748-9b30-4bac-9580-633565937905" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-06fdb748-9b30-4bac-9580-633565937905" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-fdaecf7c-1588-4659-b27f-1119c962d023" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-fdaecf7c-1588-4659-b27f-1119c962d023" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Deleting offline snapshot fdaecf7c-1588-4659-b27f-1119c962d023 of volume 06fdb748-9b30-4bac-9580-633565937905 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] snapshot_file for this snap is: volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe02bb8-2016-4eb9-b41a-6e5df2521063]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:29 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:29 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 Jul 05 20:04:29 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:30 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023" returned: 0 in 0.755s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:30 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06fdb748-9b30-4bac-9580-633565937905(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:04:30 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64b5492-9948-44b4-bdc0-49f8b9fd144f]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:30 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:30 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 Jul 05 20:04:30 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:31 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905" returned: 0 in 0.743s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:31 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 Jul 05 20:04:31 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:31 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023" returned: 0 in 0.732s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:31 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:32 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023 Jul 05 20:04:32 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:32 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:32 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905.fdaecf7c-1588-4659-b27f-1119c962d023" returned: 0 in 0.663s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-fdaecf7c-1588-4659-b27f-1119c962d023" released by "_delete_snapshot" :: held 2.979s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-06fdb748-9b30-4bac-9580-633565937905" released by "delete_snapshot" :: held 3.000s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:32 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Created reservations ['c550511b-d2df-4fd0-b08d-881e8f0c3e23', '6ea3b6ec-8f6e-4917-8180-c31753cb3350', '2c01186d-7772-41a5-a743-ab3206eb918d', '1b0065b0-8fff-40f6-b4f6-8381385ea7d3'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:32 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Delete snapshot completed successfully. Jul 05 20:04:32 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-9781cc58-9705-40ce-921b-445329042e70 tempest-ProjectMemberTests-127409771 None] Lock "cinder-fdaecf7c-1588-4659-b27f-1119c962d023-delete_snapshot" released by "delete_snapshot" :: held 3.156s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-06fdb748-9b30-4bac-9580-633565937905-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Lock "cinder-06fdb748-9b30-4bac-9580-633565937905-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-06fdb748-9b30-4bac-9580-633565937905" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:33 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-06fdb748-9b30-4bac-9580-633565937905" acquired by "delete_volume" :: waited 0.014s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:33 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd52d6da-10af-4349-ac80-78c96888a310]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:33 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:34 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 Jul 05 20:04:34 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:34 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905" returned: 0 in 0.760s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:34 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:34 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905 Jul 05 20:04:34 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:35 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-06fdb748-9b30-4bac-9580-633565937905" returned: 0 in 0.629s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:35 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-06fdb748-9b30-4bac-9580-633565937905" released by "delete_volume" :: held 1.446s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:35 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Created reservations ['5f1420cf-b7cb-417f-a95b-46de52d4d0d2', '96d8bf17-4812-407e-9ce2-bc94ce0585c7', '8b642964-bd7d-4a66-9b8a-2a39445f963d', 'f2473bc5-c221-4f18-a362-4168087e84d8'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:35 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:35 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:35 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:04:35 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:36 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.641s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:04:36 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Deleted volume successfully. Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-94ce840e-9035-4fc7-ad67-9fffd90c030c tempest-ProjectMemberTests-127409771 None] Lock "cinder-06fdb748-9b30-4bac-9580-633565937905-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (caa95ace-4d35-4af3-b525-55cc10e840ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eca0cef-aa88-49fc-a4e0-d4901a6e610b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eca0cef-aa88-49fc-a4e0-d4901a6e610b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248993726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc068b8-529a-484b-95a7-15ea776c9adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:36Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7f9d89-1030-4e78-90d4-e17998535057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7f9d89-1030-4e78-90d4-e17998535057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc742cc1-4f3c-4aeb-8d41-0608d521fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc742cc1-4f3c-4aeb-8d41-0608d521fc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcc068b8-529a-484b-95a7-15ea776c9adc', 'volume_name': 'volume-dcc068b8-529a-484b-95a7-15ea776c9adc', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c690f2-ed08-46f6-8afd-3d468d7a5ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c690f2-ed08-46f6-8afd-3d468d7a5ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0836d7a5-c367-40a9-9aee-fb36b43983da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:36 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Volume dcc068b8-529a-484b-95a7-15ea776c9adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcc068b8-529a-484b-95a7-15ea776c9adc', 'volume_size': 1} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248993726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc068b8-529a-484b-95a7-15ea776c9adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:36Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Creating volume dcc068b8-529a-484b-95a7-15ea776c9adc {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:04:36 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:04:36 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:36 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc 1073741824 Jul 05 20:04:36 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:37 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc 1073741824" returned: 0 in 0.806s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:37 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:37 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc Jul 05 20:04:37 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:38 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc" returned: 0 in 0.643s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0836d7a5-c367-40a9-9aee-fb36b43983da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcc068b8-529a-484b-95a7-15ea776c9adc', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001d5190-6ac6-431f-84fd-b1bdd68017cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:38 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Volume volume-dcc068b8-529a-484b-95a7-15ea776c9adc (dcc068b8-529a-484b-95a7-15ea776c9adc): created successfully Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001d5190-6ac6-431f-84fd-b1bdd68017cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (caa95ace-4d35-4af3-b525-55cc10e840ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:38 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-6e60aa70-fc1b-4f40-9a5f-2f383ddddf39 tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Creating offline snapshot 3eab2d9e-0b87-4529-9990-635e2ff79af9 of volume dcc068b8-529a-484b-95a7-15ea776c9adc {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e13bd9-d3e9-4821-a564-727faba2f1da]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:38 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:38 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc Jul 05 20:04:38 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:39 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc" returned: 0 in 0.756s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:39 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:39 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 1G Jul 05 20:04:39 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:40 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 1G" returned: 0 in 0.779s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc068b8-529a-484b-95a7-15ea776c9adc -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:40 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc068b8-529a-484b-95a7-15ea776c9adc -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 Jul 05 20:04:40 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:40 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc068b8-529a-484b-95a7-15ea776c9adc -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9" returned: 0 in 0.682s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:40 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 is being set with open permissions: ugo+rw Jul 05 20:04:40 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:40 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 Jul 05 20:04:40 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:41 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9" returned: 0 in 0.636s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:41 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:41 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.info Jul 05 20:04:41 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:42 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.info" returned: 0 in 0.645s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:42 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.info is being set with open permissions: ugo+rw Jul 05 20:04:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:42 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.info Jul 05 20:04:42 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:42 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.info" returned: 0 in 0.652s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:42 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.222s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:42 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-f716bd3f-d0fa-4f2e-b9f9-fbe4e3c4ca71 tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 20:04:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-3eab2d9e-0b87-4529-9990-635e2ff79af9-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-3eab2d9e-0b87-4529-9990-635e2ff79af9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-dcc068b8-529a-484b-95a7-15ea776c9adc" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-dcc068b8-529a-484b-95a7-15ea776c9adc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-3eab2d9e-0b87-4529-9990-635e2ff79af9" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:43 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-3eab2d9e-0b87-4529-9990-635e2ff79af9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Deleting offline snapshot 3eab2d9e-0b87-4529-9990-635e2ff79af9 of volume dcc068b8-529a-484b-95a7-15ea776c9adc {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:04:43 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] snapshot_file for this snap is: volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:04:44 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe74857-a8b9-43a2-bcf9-da699ce3b8cf]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:44 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 Jul 05 20:04:44 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:44 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9" returned: 0 in 0.746s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc068b8-529a-484b-95a7-15ea776c9adc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:04:44 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdb3937-9a63-4a68-b2ef-bcd616db6f33]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:44 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc Jul 05 20:04:44 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:45 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc" returned: 0 in 0.740s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:45 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 Jul 05 20:04:45 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:46 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9" returned: 0 in 0.731s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:46 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9 Jul 05 20:04:46 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:46 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc.3eab2d9e-0b87-4529-9990-635e2ff79af9" returned: 0 in 0.634s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-3eab2d9e-0b87-4529-9990-635e2ff79af9" released by "_delete_snapshot" :: held 2.941s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:46 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-dcc068b8-529a-484b-95a7-15ea776c9adc" released by "delete_snapshot" :: held 2.961s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:46 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Created reservations ['4bf881ce-08a4-47b2-bc0c-da978ba65479', 'b90fa0a5-8308-421a-9150-1f9b54a7d9af', 'cd7ddfe8-11ee-4456-acca-78e5484ccad3', 'e3ab7942-0f0f-4791-91f9-cdb30c9a7e94'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:47 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Delete snapshot completed successfully. Jul 05 20:04:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-ed7a7512-f19d-40e9-97d1-529a00861da6 tempest-ProjectMemberTests-127409771 None] Lock "cinder-3eab2d9e-0b87-4529-9990-635e2ff79af9-delete_snapshot" released by "delete_snapshot" :: held 3.094s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-dcc068b8-529a-484b-95a7-15ea776c9adc-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Lock "cinder-dcc068b8-529a-484b-95a7-15ea776c9adc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-dcc068b8-529a-484b-95a7-15ea776c9adc" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:47 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-dcc068b8-529a-484b-95a7-15ea776c9adc" acquired by "delete_volume" :: waited 0.015s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:47 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7062ee-42e9-4341-9c3f-0ef037624740]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:47 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc Jul 05 20:04:47 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:47 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc" returned: 0 in 0.751s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:47 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:48 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc Jul 05 20:04:48 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:48 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-dcc068b8-529a-484b-95a7-15ea776c9adc" returned: 0 in 0.656s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:48 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-dcc068b8-529a-484b-95a7-15ea776c9adc" released by "delete_volume" :: held 1.463s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:48 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Created reservations ['14762528-67cc-4435-a217-f3fc4cecec32', '76e3842d-2dd5-4983-b8ed-af3b923d674e', '88b7debb-9135-4209-8973-dc66d3a22537', 'cec64a8e-4acb-47e6-83b7-1170b2f1320d'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:04:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:48 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:48 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:48 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:04:48 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:49 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.637s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:04:49 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Deleted volume successfully. Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-0e66acfc-e46a-4a1e-8084-414a7199662d tempest-ProjectMemberTests-127409771 None] Lock "cinder-dcc068b8-529a-484b-95a7-15ea776c9adc-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (e80de1e6-5723-4da0-b284-66db4e5e98b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ab3e46-e1ce-4c00-b50d-b642f557a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ab3e46-e1ce-4c00-b50d-b642f557a336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438284729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a44b77-28e7-4b51-853b-ae0eccea1b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:50Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32467389-129d-4a29-9ce9-94e317b41440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32467389-129d-4a29-9ce9-94e317b41440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca3a3cb-4488-4b0b-b019-b42beb018776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca3a3cb-4488-4b0b-b019-b42beb018776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a44b77-28e7-4b51-853b-ae0eccea1b9d', 'volume_name': 'volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae6be8b-6a63-47ec-9d95-5d6ccb2088a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae6be8b-6a63-47ec-9d95-5d6ccb2088a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c992f4-69dc-4863-a662-17baa079e594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:49 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Volume e4a44b77-28e7-4b51-853b-ae0eccea1b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d', 'volume_size': 1} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438284729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a44b77-28e7-4b51-853b-ae0eccea1b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a2f60937584668be70230705fe05de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T18:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T18:04:50Z,use_quota=True,user_id='c1fa43849480452ea58e3b481088926d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e0b505-c616-4162-96fd-5640a71778d1),volume_type_id=d7e0b505-c616-4162-96fd-5640a71778d1)}" {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Creating volume e4a44b77-28e7-4b51-853b-ae0eccea1b9d {{(pid=86389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Selected osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 as target Quobyte volume. {{(pid=86389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 20:04:49 devstack cinder-volume[86389]: INFO cinder.volume.drivers.remotefs [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] casted to osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90 Jul 05 20:04:49 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d 1073741824 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:49 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d 1073741824 Jul 05 20:04:49 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:50 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d 1073741824" returned: 0 in 0.853s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:50 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:INSERT=33,cinder:UPDATE=137,cinder:SELECT=98,cinder:DELETE=12 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:04:50 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:50 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d Jul 05 20:04:50 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:51 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" returned: 0 in 0.641s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:51 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'} {{(pid=86389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 20:04:51 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c992f4-69dc-4863-a662-17baa079e594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d', 'volume_size': 1}' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93869caa-6728-4e0b-877d-8e58f3e89bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 20:04:51 devstack cinder-volume[86389]: INFO cinder.volume.flows.manager.create_volume [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Volume volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d (e4a44b77-28e7-4b51-853b-ae0eccea1b9d): created successfully Jul 05 20:04:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93869caa-6728-4e0b-877d-8e58f3e89bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 20:04:51 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Flow 'volume_create_manager' (e80de1e6-5723-4da0-b284-66db4e5e98b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 20:04:51 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-4fc2fda2-6e2d-4e7e-8a4b-b888f7f4e372 tempest-ProjectMemberTests-127409771 None] Created volume successfully. Jul 05 20:04:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:04:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:04:52 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Creating offline snapshot a12654f3-597f-462b-b49e-da7ad484f2d4 of volume e4a44b77-28e7-4b51-853b-ae0eccea1b9d {{(pid=86389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 20:04:52 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9da359-1844-46cc-a231-857371c824b0]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:52 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d Jul 05 20:04:52 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:52 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" returned: 0 in 0.759s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:52 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 1G {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:52 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 1G Jul 05 20:04:52 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:53 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 1G" returned: 0 in 0.802s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:53 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:53 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 Jul 05 20:04:53 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:54 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d -F qcow2 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4" returned: 0 in 0.674s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:54 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 is being set with open permissions: ugo+rw Jul 05 20:04:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:54 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 Jul 05 20:04:54 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:54 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4" returned: 0 in 0.647s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:54 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.info Jul 05 20:04:54 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:55 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.info" returned: 0 in 0.637s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:55 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.remotefs [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.info is being set with open permissions: ugo+rw Jul 05 20:04:55 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.info {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:55 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.info Jul 05 20:04:55 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:56 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.info" returned: 0 in 0.640s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:56 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.240s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:04:56 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-692a4003-2900-4794-8eda-34181413515f tempest-ProjectMemberTests-127409771 None] Create snapshot completed successfully Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-a12654f3-597f-462b-b49e-da7ad484f2d4-delete_snapshot" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Lock "cinder-a12654f3-597f-462b-b49e-da7ad484f2d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" by "delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-a12654f3-597f-462b-b49e-da7ad484f2d4" by "_delete_snapshot" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-a12654f3-597f-462b-b49e-da7ad484f2d4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Deleting offline snapshot a12654f3-597f-462b-b49e-da7ad484f2d4 of volume e4a44b77-28e7-4b51-853b-ae0eccea1b9d {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] snapshot_file for this snap is: volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 {{(pid=86389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a5715b-0a83-405d-bfc3-1f177dbcd014]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:57 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:57 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 Jul 05 20:04:57 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:58 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4" returned: 0 in 0.761s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:58 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 20:04:58 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0287b6-5a1f-404f-8fd1-2ce5580f6492]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:04:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:58 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d Jul 05 20:04:58 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:58 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" returned: 0 in 0.753s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:58 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:58 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 Jul 05 20:04:58 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:04:59 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 05 20:04:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4" returned: 0 in 0.737s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:04:59 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:04:59 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4 Jul 05 20:04:59 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:05:00 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 05 20:05:00 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d.a12654f3-597f-462b-b49e-da7ad484f2d4" returned: 0 in 0.651s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:05:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-a12654f3-597f-462b-b49e-da7ad484f2d4" released by "_delete_snapshot" :: held 2.994s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:05:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" released by "delete_snapshot" :: held 3.015s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:05:00 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=114,cinder:SELECT=83,cinder:INSERT=32,cinder:DELETE=10 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:05:00 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Created reservations ['8746b46b-ce47-458e-a5ed-b5ad22cb46cd', '0e589f6b-8ae3-4f2f-8a58-741108b19b15', '0a51b236-00d3-44bb-b8fc-6937605babe8', '6c7ff913-8a1a-4842-8831-41dad922224a'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:05:00 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Delete snapshot completed successfully. Jul 05 20:05:00 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-e8f43dbe-a27c-41f8-a1e8-ec039d5cbe19 tempest-ProjectMemberTests-127409771 None] Lock "cinder-a12654f3-597f-462b-b49e-da7ad484f2d4-delete_snapshot" released by "delete_snapshot" :: held 3.157s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:05:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-e4a44b77-28e7-4b51-853b-ae0eccea1b9d-delete_volume" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:05:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Lock "cinder-e4a44b77-28e7-4b51-853b-ae0eccea1b9d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:05:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Acquiring lock "cinder-quobyte-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" by "delete_volume" {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 20:05:01 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" acquired by "delete_volume" :: waited 0.016s {{(pid=86389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 20:05:01 devstack cinder-volume[86389]: DEBUG oslo.privsep.daemon [-] privsep: reply[111c23a1-ddca-4c5c-8695-b1329c0f2ad9]: (4, 'qcow2') {{(pid=87316) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 20:05:01 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:05:01 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d Jul 05 20:05:01 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:05:02 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 05 20:05:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" returned: 0 in 0.745s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:05:02 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:05:02 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d Jul 05 20:05:02 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:05:03 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e/volume-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" returned: 0 in 0.639s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Lock "cinder-quobyte-e4a44b77-28e7-4b51-853b-ae0eccea1b9d" released by "delete_volume" :: held 1.438s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG cinder.quota [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Created reservations ['8446e9d0-5adf-490f-aee3-9b9da9b1c7b4', 'b384c762-cdd9-4d6d-8295-0817a0a64431', 'd3a8fba6-2ad5-4276-a89d-4488b5e566ce', '923951c1-3a26-49cd-bfcb-f75a8b1b4d58'] {{(pid=86389) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:05:03 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:05:03 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:05:03 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.645s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:05:03 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Deleted volume successfully. Jul 05 20:05:03 devstack cinder-volume[86389]: DEBUG cinder.coordination [None req-2c5881ff-b061-49e9-b7bc-955712c0e17a tempest-ProjectMemberTests-127409771 None] Lock "cinder-e4a44b77-28e7-4b51-853b-ae0eccea1b9d-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86389) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 20:05:13 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:INSERT=5,cinder:UPDATE=12,cinder:SELECT=7 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:05:13 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writing DB stats cinder:UPDATE=19,cinder:SELECT=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50385aba-be40-49ca-a4ef-351a37552e90'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 20:05:16 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e Jul 05 20:05:16 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 20:05:16 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e655abbd625e7d51489960c0933a0f7e" returned: 0 in 0.658s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG oslo_service.periodic_task [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] Running periodic task VolumeManager._thread_info {{(pid=86389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread count: 28 {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 20:05:16 devstack cinder-volume[86389]: DEBUG cinder.volume.manager [None req-1073dcf3-125d-41b1-b52f-2011ab023a01 None None] thread info: [<_MainThread(MainThread, started 124275255455872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}